-- Logs begin at Fri 2022-09-09 15:52:10 UTC, end at Fri 2022-09-09 16:53:42 UTC. -- Sep 09 16:22:50.069429 dv-cinder-831247-27-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 09 16:22:50.078769 dv-cinder-831247-27-iscsi devstack@n-api.service[105532]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 09 16:22:50.080768 dv-cinder-831247-27-iscsi devstack@n-api.service[105532]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Sep 9 16:22:50 2022] *** Sep 09 16:22:50.080768 dv-cinder-831247-27-iscsi devstack@n-api.service[105532]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 09 16:22:50.080768 dv-cinder-831247-27-iscsi devstack@n-api.service[105532]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 09 16:22:50.080768 dv-cinder-831247-27-iscsi devstack@n-api.service[105532]: nodename: dv-cinder-831247-27-iscsi Sep 09 16:22:50.080768 dv-cinder-831247-27-iscsi devstack@n-api.service[105532]: machine: x86_64 Sep 09 16:22:50.080768 dv-cinder-831247-27-iscsi devstack@n-api.service[105532]: clock source: unix Sep 09 16:22:50.080768 dv-cinder-831247-27-iscsi devstack@n-api.service[105532]: pcre jit disabled Sep 09 16:22:50.080768 dv-cinder-831247-27-iscsi devstack@n-api.service[105532]: detected number of CPU cores: 4 Sep 09 16:22:50.080768 dv-cinder-831247-27-iscsi devstack@n-api.service[105532]: current working directory: / Sep 09 16:22:50.080768 dv-cinder-831247-27-iscsi devstack@n-api.service[105532]: detected binary path: /usr/bin/uwsgi-core Sep 09 16:22:50.081480 dv-cinder-831247-27-iscsi devstack@n-api.service[105532]: your processes number limit is 47680 Sep 09 16:22:50.081480 dv-cinder-831247-27-iscsi devstack@n-api.service[105532]: your memory page size is 4096 bytes Sep 09 16:22:50.081480 dv-cinder-831247-27-iscsi devstack@n-api.service[105532]: detected max file descriptor number: 2048 Sep 09 16:22:50.081480 dv-cinder-831247-27-iscsi devstack@n-api.service[105532]: lock engine: pthread robust mutexes Sep 09 16:22:50.081480 dv-cinder-831247-27-iscsi devstack@n-api.service[105532]: thunder lock: enabled Sep 09 16:22:50.081480 dv-cinder-831247-27-iscsi devstack@n-api.service[105532]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 09 16:22:50.081480 dv-cinder-831247-27-iscsi devstack@n-api.service[105532]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 09 16:22:50.119588 dv-cinder-831247-27-iscsi devstack@n-api.service[105532]: Python main interpreter initialized at 0x559b938d79c0 Sep 09 16:22:50.119588 dv-cinder-831247-27-iscsi devstack@n-api.service[105532]: python threads support enabled Sep 09 16:22:50.119588 dv-cinder-831247-27-iscsi devstack@n-api.service[105532]: your server socket listen backlog is limited to 100 connections Sep 09 16:22:50.119588 dv-cinder-831247-27-iscsi devstack@n-api.service[105532]: your mercy for graceful operations on workers is 90 seconds Sep 09 16:22:50.119943 dv-cinder-831247-27-iscsi devstack@n-api.service[105532]: mapped 403077 bytes (393 KB) for 2 cores Sep 09 16:22:50.120018 dv-cinder-831247-27-iscsi devstack@n-api.service[105532]: *** Operational MODE: preforking *** Sep 09 16:22:50.120250 dv-cinder-831247-27-iscsi devstack@n-api.service[105532]: *** uWSGI is running in multiple interpreter mode *** Sep 09 16:22:50.120250 dv-cinder-831247-27-iscsi devstack@n-api.service[105532]: spawned uWSGI master process (pid: 105532) Sep 09 16:22:50.120453 dv-cinder-831247-27-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 09 16:22:50.121503 dv-cinder-831247-27-iscsi devstack@n-api.service[105532]: spawned uWSGI worker 1 (pid: 105533, cores: 1) Sep 09 16:22:50.121503 dv-cinder-831247-27-iscsi devstack@n-api.service[105532]: spawned uWSGI worker 2 (pid: 105534, cores: 1) Sep 09 16:22:50.121503 dv-cinder-831247-27-iscsi devstack@n-api.service[105532]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 09 16:22:50.765992 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 09 16:22:50.776160 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 09 16:22:51.827984 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 16:22:51.827984 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: from cryptography.utils import int_from_bytes Sep 09 16:22:51.828633 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 16:22:51.828633 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: from cryptography.utils import int_from_bytes Sep 09 16:22:51.829009 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 16:22:51.829009 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: from cryptography.utils import int_from_bytes Sep 09 16:22:51.829122 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 16:22:51.829122 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: from cryptography.utils import int_from_bytes Sep 09 16:22:54.289267 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 09 16:22:54.289859 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 09 16:22:54.290006 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 09 16:22:54.290101 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 09 16:22:54.290429 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 09 16:22:54.290521 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 09 16:22:54.290634 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 09 16:22:54.290904 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 09 16:22:54.291046 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.291237 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 09 16:22:54.291348 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.291491 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 09 16:22:54.291595 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.291904 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.292036 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.292186 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.292282 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.292525 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.292659 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.292839 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.292979 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.293148 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.293295 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.293463 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.293592 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.293677 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.293754 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.294005 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.294156 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.294329 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-831247-27-iscsi {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.294472 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.294637 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.294733 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.294961 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.295093 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.295286 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.295480 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-831247-27-iscsi {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.295570 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.295649 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.295863 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.295995 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.296156 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.296244 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.296448 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.296535 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.296755 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.296950 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.297113 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.298136 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.298277 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.298277 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.298474 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.298636 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.298764 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.298851 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.298935 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.299103 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.299229 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.299312 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.299394 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.299470 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.299611 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.299693 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.299777 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.299903 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.299981 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.300057 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.300247 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.300469 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-831247-27-iscsi {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.300563 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.300780 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.300920 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.301110 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.301260 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-831247-27-iscsi {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.301416 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.301624 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.301827 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.301917 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.302130 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.302234 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.302434 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.302572 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.302774 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.302869 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.303088 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.303193 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.303400 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.303493 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.303706 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.303793 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.304020 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.304114 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.304329 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.304416 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.304640 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.304727 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.304935 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.305022 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.305236 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.305324 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.305537 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.305625 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.305847 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.305935 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.306127 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.306217 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.306427 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.306567 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.306698 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.306782 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.307000 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.307109 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.307271 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.307364 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.307577 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.307661 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.307895 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.307986 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.308146 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.308238 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.308739 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.308864 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.309052 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.309137 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.309348 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.309433 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.309655 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.309742 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.309957 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.310049 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.310257 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.310348 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.310578 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.310666 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.310881 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.311015 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.311181 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.311264 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.311477 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.311560 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.311777 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.311882 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.312076 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.312159 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.312380 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.312463 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.312695 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.312795 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.312995 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.313087 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.313312 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.313395 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.313616 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.313701 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.23 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.313931 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.23 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.314013 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.314233 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.314317 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.23 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.314574 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.23 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.314671 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.314880 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.314964 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.315184 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.315267 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.315500 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.315631 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.315804 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.315895 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.316104 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.316186 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.316404 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.316489 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.316728 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.316846 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.317066 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.317151 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.317376 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.317460 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.317684 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.317774 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.317932 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.318028 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.318226 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.318317 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.318550 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.318706 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.318851 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.318956 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.319159 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.319243 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.319451 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.319533 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.319750 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.319841 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.320044 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.320134 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.320342 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.320424 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.320638 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.320729 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.320937 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.321028 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.321235 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.321321 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.321541 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.321625 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.321847 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.321969 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.322144 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.322240 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.322441 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.322578 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.322764 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.322866 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.323064 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.323171 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.323365 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.323461 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.323664 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.323759 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.323965 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.324064 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.324267 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.324367 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.324567 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.324668 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.324865 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.324947 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.325164 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.325257 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.325469 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.325552 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.325766 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.325847 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.326069 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.326152 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.326369 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.326472 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.326690 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.326777 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.327005 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.327096 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.327308 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.327396 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.327609 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.327694 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.327910 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.327993 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.328204 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.328302 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.328508 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.328601 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.328803 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.328886 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.329105 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.329188 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.329403 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.329498 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.329701 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.329785 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.329999 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.330081 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.330294 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.330386 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.330614 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.330701 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.330912 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.330994 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.331210 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.331313 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.331502 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.331584 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.331796 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.331902 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.332092 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.332180 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.332428 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.332532 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.332784 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.332867 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.333093 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.333177 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.333402 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.333486 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.333764 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.333856 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.334030 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:22:54.334116 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.334364 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.334448 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.334699 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.334796 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.335029 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.335126 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.335343 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.335425 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.335656 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.335752 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.335968 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.336054 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.336278 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.336369 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.336586 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.336720 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.336894 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.336986 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.337202 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.337286 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.337518 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.337620 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.337815 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.337899 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.338123 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.338241 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.338438 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.338566 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.338780 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.338866 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.339093 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.339182 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.339404 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.339495 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.339710 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.339800 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.340024 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.340108 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.340334 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.340428 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.340646 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.340728 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.340953 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.341044 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.341275 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.341359 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.341584 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.341679 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.341908 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.341999 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.342227 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.342322 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.342562 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.342651 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.342871 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.342954 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.343178 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.343263 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.343488 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.343570 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.343800 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.343884 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.344108 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.344194 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.344417 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.344505 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.344730 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.344899 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.345036 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.345131 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.345349 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.345431 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.345654 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.345752 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.345958 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.346051 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.346268 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.346352 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.346603 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.346701 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.346911 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.347004 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.347218 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.347303 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.347525 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.347618 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.347841 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.347929 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.348215 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.348371 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.348532 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.348625 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.348847 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.348930 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.349154 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.349237 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.349462 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.349547 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.349767 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.349850 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.350066 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.350148 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.350368 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.350454 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.350691 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.350788 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.350993 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.351089 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.351287 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.351371 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.351593 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.351685 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.351895 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.351985 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.352196 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.352370 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.352519 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.352612 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.352818 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.352915 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.353124 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.353208 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.353429 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.353512 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.353732 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.353824 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.354030 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.354118 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.354337 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.354419 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.354663 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.354766 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.354963 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.355054 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.355274 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.355356 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.355579 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.355672 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.355877 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.355959 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.356195 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.356288 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.356494 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.356578 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.356791 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.356919 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.357100 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.357183 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.357403 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.357487 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.357708 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.357793 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.358016 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.358107 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.358322 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.358406 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.358653 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.358740 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.358964 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.359047 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.359268 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.359832 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.359832 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.359978 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.360054 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.360140 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.360219 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.360303 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.360501 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.360586 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.360805 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.360902 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.361120 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.361203 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.361420 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.361542 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.361727 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.361821 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.362027 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.362110 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.362327 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.362418 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.362648 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.362747 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.362951 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.363036 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.363246 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.363328 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.363546 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.363646 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.363871 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.363954 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.364170 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.364253 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.364468 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.364560 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.364770 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.364861 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.365076 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.365166 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.365373 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.365456 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.365669 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.365751 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.365965 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.366049 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.366271 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.366364 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.366593 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.366682 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.366929 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.367024 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.367228 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.367312 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.367553 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.367639 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.367869 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.367965 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.368186 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.368289 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.368484 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.368572 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.368790 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.368883 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.369094 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.369176 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.369399 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.369485 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.369702 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.369832 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.370008 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.370103 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.370314 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.370398 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.370649 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.370736 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.370956 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.371057 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.371270 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.371352 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.371572 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.371656 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.371908 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.371993 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.372181 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.372272 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.372491 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.372580 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.372794 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.372877 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.373108 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.373192 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.373430 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.373517 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.373745 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.373843 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.374051 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.374134 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.374360 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.374445 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.374688 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.374776 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.374996 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.375093 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.375302 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.375386 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.375605 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.375697 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.375911 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.376004 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.376213 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.376296 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.376527 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.376617 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.376829 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.376920 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.377142 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.377226 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.377440 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.377522 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.377752 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.377844 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.378050 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.378143 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.378358 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.378450 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.378688 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.378775 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.379005 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.379097 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.379402 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.379485 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.379733 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.379819 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.380044 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.380144 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.380352 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.380437 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.380652 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.380736 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.380958 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.381043 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.381258 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.381341 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.381558 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.381643 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.381867 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.381958 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.382164 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.382257 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.382467 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.382617 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.382795 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.382880 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.383095 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.383187 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.383405 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.383489 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.383705 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.383787 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.384005 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.384101 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.384303 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.384387 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.384607 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.384690 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.384914 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.385006 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.385220 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.385311 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.385540 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.385634 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.385846 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.385937 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.386168 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.386267 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.386470 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.386573 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.386801 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.386892 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.387106 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.387234 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.387407 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.387491 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.387707 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.387840 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.388008 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.388092 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.388313 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.388397 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.388618 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.388710 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.388923 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.389006 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.389234 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.389451 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.389553 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.389632 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.389839 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.389931 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.390144 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.390247 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.390447 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.390575 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.390775 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.390860 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.391081 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.391179 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.391385 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.391467 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.391689 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.391772 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.391994 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.392096 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.392298 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.392382 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.392600 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.392682 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.392907 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.393000 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.393210 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.393301 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.393508 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.393591 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.393812 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.393897 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.394117 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.394201 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.394415 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.394519 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.394744 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.394831 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.395076 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.395158 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.395384 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.395657 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.395754 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.395984 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.396252 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.396336 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.396591 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.396675 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.396906 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.396992 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.397223 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.397362 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.397545 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.397636 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.397867 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.398039 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.398174 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.398258 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.398476 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.398601 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.398807 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.398890 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.399111 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.399195 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.399408 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.399490 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.399707 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.399790 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.400004 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.400088 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.400304 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.400396 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.400602 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.400695 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.400903 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.400987 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.401197 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.401287 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.401497 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.401592 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.401793 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.401885 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.402089 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.402181 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.402389 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.402482 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.402710 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.402793 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.403016 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.403099 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.403315 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.403410 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.403623 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.403745 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.403924 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.404008 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.404226 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.404311 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.404529 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.404613 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.404825 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.404909 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.405126 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.405216 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.405428 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.405512 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.405768 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.405861 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.406070 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.406160 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.406403 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.406487 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.406726 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.406822 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.407027 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.407112 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.407345 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.407428 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.407643 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.407735 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.407945 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.408029 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.408243 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.408327 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.408543 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.408635 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.408845 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.408930 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.409140 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.409229 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.409444 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.409535 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.409744 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.409834 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.410047 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.410139 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.410350 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.410443 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.410722 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.410828 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.411028 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.411113 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.411325 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.411410 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.411630 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.411720 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.411930 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.412051 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.412226 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.412321 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.412520 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.412655 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.412819 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.412904 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.413119 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.413203 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.413414 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.413499 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.413718 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.413815 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.414017 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.414107 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.414324 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.414407 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.414644 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.414747 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.414943 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.415027 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.415242 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.415325 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.415538 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.415634 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.415838 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.415923 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.416132 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.416221 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.416435 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.416532 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.416733 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.416818 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.417028 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.417110 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.417326 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.417428 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.417632 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.417725 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.417931 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.418014 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.418225 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.418308 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.418542 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.418627 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.418846 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.418930 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.419152 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.419238 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.419447 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.419530 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.419750 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.419834 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.420047 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.420131 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.420346 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.420429 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.420645 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.420738 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.420946 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.421028 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.421238 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.421320 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.421535 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.421627 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.421832 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.421922 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.422127 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.422208 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.422422 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.422541 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.422747 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.422831 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.423047 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.423133 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.423343 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.423435 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.423642 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.423725 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.423938 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.424021 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.424237 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.424329 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.424539 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.424629 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.424880 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.424964 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.425179 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.425264 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.425487 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.425570 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.425801 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.425885 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.426133 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.426221 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.426442 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.426545 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.426772 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.426856 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.427073 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.427166 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.427381 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.427464 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.427684 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.427785 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.427991 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.428117 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.428291 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.428379 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.428587 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.428679 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.428887 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.428970 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.429190 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.429273 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.429491 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.429581 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.429802 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.429891 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.430113 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.430197 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.430427 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.430569 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.430751 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.430847 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.431055 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.431139 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.431358 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.431459 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.431659 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.431743 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.431964 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.432047 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.432268 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.432352 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.432573 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.432657 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.432877 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.432958 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.433183 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.433632 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.433851 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.433936 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.434157 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.434247 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.434458 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.434570 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.434788 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.434880 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.435092 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.435182 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.435389 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.435473 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.435694 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.435777 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.435996 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.436089 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.436296 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.436379 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.436600 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.436684 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.436898 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.436989 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.437204 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.437288 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.437499 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.437582 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.437803 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.437919 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.438106 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.438233 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.438547 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.438647 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.438859 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.438963 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.439167 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.439254 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.439470 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.439558 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.439780 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.439867 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.440085 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.440169 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.440384 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.440469 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.440698 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.440791 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.441000 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.441087 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.441379 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.441464 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.441686 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.441802 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.442037 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.442132 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.442337 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.442436 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.442666 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.442769 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.442985 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.443093 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.443287 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.443395 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.443583 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.443671 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.443880 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.443965 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.444192 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.444287 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.444489 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.444574 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.444805 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.444891 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.445105 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.445201 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.445428 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.445514 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.445790 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.445881 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.446136 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.446230 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.446439 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.446545 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.446805 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.446890 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.447124 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.447300 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.447442 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.447538 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.447767 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.447927 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.448061 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.448194 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.448365 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.448495 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.448669 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.448796 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.448979 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.449104 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.449286 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.449425 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.449595 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.449736 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.449907 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.450036 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.450208 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.450340 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.450538 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.450644 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.450849 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.450946 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.451152 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.451246 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.451466 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.451558 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.451775 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.451878 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.452095 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.452182 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.452477 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.452561 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.452796 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.452889 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.453103 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.453187 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.453403 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.453496 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.453701 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.453796 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.454009 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.454106 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.454309 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.454393 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.454639 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.454739 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.454942 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.455033 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.455244 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.455330 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.455549 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.455644 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.455852 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.455936 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.456157 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.456240 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.456456 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.456543 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.456757 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.456843 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.457058 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.457143 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.457387 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.457475 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.457706 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.457789 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.458008 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.458104 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.458325 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.458410 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.458658 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.458749 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.458962 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.459058 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.459279 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.459363 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.459578 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.459661 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.459874 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.459970 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.460177 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.460261 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.460481 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.460565 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.460785 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.460892 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.461089 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.461186 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.461406 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.461499 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.461712 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.461809 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.462029 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.462114 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.462332 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.462415 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.462691 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.462787 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.463001 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.463084 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.463320 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.463408 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.463631 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.463725 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.463945 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.464038 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.464252 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.464344 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.464553 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.464640 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.464853 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.464939 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.465158 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.465250 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.465457 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.465543 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.465758 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.465841 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.466056 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.466149 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.466357 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.466449 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.466677 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.466763 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.466980 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.467076 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.467279 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.467370 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.467577 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.467661 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.467877 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.467981 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.468194 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.468286 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.468494 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.468581 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.468798 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.468894 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.469099 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.469184 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.469397 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.469479 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.469698 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.469784 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.469993 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.470107 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.470329 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.470419 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.470650 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.470739 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.470969 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.471054 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.471276 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.471372 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.471584 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.471670 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.471897 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.471983 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.472208 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.472299 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.472517 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.472602 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.472826 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.472919 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.473185 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.473288 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.473492 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.473624 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.473808 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.473901 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.474113 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.474208 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.474426 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.474545 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.474763 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.474960 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.475080 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.475289 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.475595 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.475682 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.475906 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.475989 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.476218 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.476312 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.476533 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.476617 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.476845 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.476928 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.477151 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.477237 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.477458 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.477550 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.477762 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.477846 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.478068 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.478154 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.478378 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.478461 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.478716 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.478804 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.479036 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.479122 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.479357 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.479441 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.479668 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.479761 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.479978 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.480063 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.480286 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.480372 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.480596 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.480690 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.480909 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.480995 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.481220 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.481444 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.481545 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.481633 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.481822 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.481908 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.482131 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.482225 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.482439 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.482544 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.482771 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.482856 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.483077 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.483176 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.483384 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.483469 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.483690 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.483782 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.483998 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.484095 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.484300 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.484384 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.484608 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.484692 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.484912 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.485004 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.485220 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.485303 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.485530 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.485633 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.485847 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.485932 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.486155 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.486240 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.486466 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.486616 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.486800 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.486896 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.487111 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.487308 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.487425 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.487618 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.487939 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.488026 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.488249 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.488334 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.488585 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.488672 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.488905 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.488998 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.489218 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.489303 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.489532 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.489630 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.489832 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.489917 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.490132 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.490216 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.490439 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.490554 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.490768 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.490862 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.491068 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.491151 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.491373 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.491517 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.491676 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.491772 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.491975 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.492059 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.492289 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.492387 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.492589 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.492675 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.492908 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.493112 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.493281 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.493452 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.493731 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.493818 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.494073 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.494158 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.494386 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.494473 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.494728 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.494815 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.495033 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.495128 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.495352 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.495437 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.495652 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.495735 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.495953 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.496038 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.496258 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.496343 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.496560 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.496645 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.496856 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.496952 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.497155 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.497241 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.497455 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.497538 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.497757 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.497851 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.498054 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.498137 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.498358 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.498450 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.498682 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.498778 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.498990 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.499074 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.499290 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.499382 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.499586 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.499679 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.499887 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.499979 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.500191 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.500275 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.500488 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.500573 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.500786 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.500877 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.501085 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.501175 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.501383 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.501468 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.501686 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.501779 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.501980 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.502064 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.502285 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.502369 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.502609 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.502700 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.502915 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.503000 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.503212 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.503304 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.503519 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.503604 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.503836 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.503928 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.504152 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.504286 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.504504 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.504589 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.504802 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.504900 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.505112 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.505204 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.505413 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.505500 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.505725 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.505819 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.506032 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.506115 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.506338 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.506423 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.506671 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.506774 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.506981 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.507067 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.507323 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.507511 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.507635 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.507842 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.508161 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.508252 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.508491 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.508576 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.508813 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.508898 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.509113 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.509197 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.509416 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.509501 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.509718 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.509804 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.510036 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.510121 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.510338 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.510421 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.510668 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.510755 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.510976 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.511073 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.511283 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.511376 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.511588 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.511717 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.511891 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.511976 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.512194 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.512289 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.512499 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.512590 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.512801 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.512886 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.513106 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.513199 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.513407 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.513492 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.513711 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.513796 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.514016 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.514108 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.514317 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.514401 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.514646 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.514735 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.514954 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.515042 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.515270 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.515356 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.515582 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.515666 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.515892 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.515985 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.516204 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.516290 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.516508 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.516601 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.516813 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.516898 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.517117 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.517203 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.517419 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.517512 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.517726 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.517810 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.518036 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.518128 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.518344 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.518437 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.518676 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.518763 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.518999 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.519304 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.519405 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.519624 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.519992 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.520079 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.520312 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.520395 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.520622 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.520708 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.520943 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.521026 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.521257 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.521343 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.521564 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.521648 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.521884 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.521971 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.522193 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.522356 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.522529 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.522630 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.522837 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.522923 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.523165 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.523263 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.523492 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.523584 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.523795 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.523888 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.524098 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.524192 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.524401 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.524487 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.524706 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.524790 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.525008 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.525101 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.525309 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.525393 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.525607 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.525692 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.525906 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.525991 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.526204 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.526287 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.526515 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.526600 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.526829 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.526923 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.527129 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.527214 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.527426 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.527511 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.527726 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.527812 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.528052 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.528183 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.528318 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.528417 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.528617 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.528702 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.528916 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.528999 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.529215 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.529352 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.529512 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.529597 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.529808 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.529892 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.530103 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.530201 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.530404 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.530489 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.530724 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.530812 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.531021 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.531119 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.531317 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.531410 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.531613 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.531697 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.531913 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.532000 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.532241 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.532327 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.532557 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.532641 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.532863 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.532950 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.533179 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.533304 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.533485 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.533569 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.533802 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.533887 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.534102 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.534227 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.534410 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.534527 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.534738 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.534825 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.535048 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.535132 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.535354 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.535465 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.535684 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.535768 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.535994 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.536079 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.536300 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.536392 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.536601 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.536685 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.536904 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.536990 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.537206 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.537300 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.537512 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.537597 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.537821 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.537904 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.538137 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.538224 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.538436 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.538551 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.538785 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.538871 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.539102 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.539189 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.539419 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.539504 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.539732 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.539817 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.540038 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.540138 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.540341 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.540425 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.540642 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.540736 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.540947 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.541038 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.541250 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.541334 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.541554 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.541646 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.541856 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.541974 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.542162 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.542247 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.542473 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.542613 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.542803 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.542895 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.543114 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.543197 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.543425 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.543511 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.543727 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.543811 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.544051 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.544143 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.544358 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.544451 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.544678 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.544764 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.544990 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.545073 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.545324 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.545411 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.545630 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.545715 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.545938 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.546020 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.546245 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.546330 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.546567 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.546655 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.546806 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 09 16:22:54.546903 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.547183 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:22:54.547424 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 09 16:22:54.702781 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: INFO dbcounter [None req-23a31d05-a6a7-4ed4-8c5c-3b11d0cc4f76 None None] Registered counter for database nova_api Sep 09 16:22:54.703043 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: INFO dbcounter [None req-b42b82ef-d6ed-4b0a-85cf-7571a73e27fb None None] Registered counter for database nova_api Sep 09 16:22:54.724114 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG oslo_db.sqlalchemy.engines [None req-b42b82ef-d6ed-4b0a-85cf-7571a73e27fb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105533) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 16:22:54.726854 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG oslo_db.sqlalchemy.engines [None req-23a31d05-a6a7-4ed4-8c5c-3b11d0cc4f76 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105534) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 16:22:54.734140 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG dbcounter [-] [105533] Writer thread running {{(pid=105533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 16:22:54.736775 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG dbcounter [-] [105534] Writer thread running {{(pid=105534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 16:22:54.791303 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.context [None req-b42b82ef-d6ed-4b0a-85cf-7571a73e27fb None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),48ce3bd6-80cf-484b-9bda-21ff297cb34a(cell1) {{(pid=105533) load_cells /opt/stack/nova/nova/context.py:464}} Sep 09 16:22:54.793090 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.context [None req-23a31d05-a6a7-4ed4-8c5c-3b11d0cc4f76 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),48ce3bd6-80cf-484b-9bda-21ff297cb34a(cell1) {{(pid=105534) load_cells /opt/stack/nova/nova/context.py:464}} Sep 09 16:22:54.795215 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG oslo_concurrency.lockutils [None req-b42b82ef-d6ed-4b0a-85cf-7571a73e27fb None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:22:54.795689 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG oslo_concurrency.lockutils [None req-b42b82ef-d6ed-4b0a-85cf-7571a73e27fb None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:22:54.797113 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG oslo_concurrency.lockutils [None req-23a31d05-a6a7-4ed4-8c5c-3b11d0cc4f76 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:22:54.797248 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG oslo_concurrency.lockutils [None req-b42b82ef-d6ed-4b0a-85cf-7571a73e27fb None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:22:54.797584 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG oslo_concurrency.lockutils [None req-23a31d05-a6a7-4ed4-8c5c-3b11d0cc4f76 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:22:54.797925 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG oslo_concurrency.lockutils [None req-b42b82ef-d6ed-4b0a-85cf-7571a73e27fb None None] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:22:54.798360 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG oslo_concurrency.lockutils [None req-b42b82ef-d6ed-4b0a-85cf-7571a73e27fb None None] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:22:54.799200 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG oslo_concurrency.lockutils [None req-23a31d05-a6a7-4ed4-8c5c-3b11d0cc4f76 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:22:54.799907 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG oslo_concurrency.lockutils [None req-23a31d05-a6a7-4ed4-8c5c-3b11d0cc4f76 None None] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:22:54.800339 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG oslo_concurrency.lockutils [None req-23a31d05-a6a7-4ed4-8c5c-3b11d0cc4f76 None None] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:22:54.800559 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG oslo_concurrency.lockutils [None req-b42b82ef-d6ed-4b0a-85cf-7571a73e27fb None None] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:22:54.802376 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG oslo_concurrency.lockutils [None req-23a31d05-a6a7-4ed4-8c5c-3b11d0cc4f76 None None] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:22:54.802547 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: INFO dbcounter [None req-b42b82ef-d6ed-4b0a-85cf-7571a73e27fb None None] Registered counter for database nova_cell0 Sep 09 16:22:54.804459 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: INFO dbcounter [None req-23a31d05-a6a7-4ed4-8c5c-3b11d0cc4f76 None None] Registered counter for database nova_cell0 Sep 09 16:22:54.806675 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: INFO dbcounter [None req-b42b82ef-d6ed-4b0a-85cf-7571a73e27fb None None] Registered counter for database nova_cell1 Sep 09 16:22:54.808800 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: INFO dbcounter [None req-23a31d05-a6a7-4ed4-8c5c-3b11d0cc4f76 None None] Registered counter for database nova_cell1 Sep 09 16:22:54.815571 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG oslo_db.sqlalchemy.engines [None req-b42b82ef-d6ed-4b0a-85cf-7571a73e27fb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105533) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 16:22:54.817260 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG oslo_db.sqlalchemy.engines [None req-b42b82ef-d6ed-4b0a-85cf-7571a73e27fb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105533) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 16:22:54.819006 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG oslo_db.sqlalchemy.engines [None req-23a31d05-a6a7-4ed4-8c5c-3b11d0cc4f76 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105534) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 16:22:54.822815 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG oslo_db.sqlalchemy.engines [None req-23a31d05-a6a7-4ed4-8c5c-3b11d0cc4f76 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105534) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 16:22:54.823344 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG dbcounter [-] [105533] Writer thread running {{(pid=105533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 16:22:54.824894 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG dbcounter [-] [105534] Writer thread running {{(pid=105534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 16:22:54.825594 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG dbcounter [-] [105533] Writer thread running {{(pid=105533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 16:22:54.961730 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG dbcounter [-] [105534] Writer thread running {{(pid=105534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 16:22:54.966207 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: INFO dbcounter [None req-b42b82ef-d6ed-4b0a-85cf-7571a73e27fb None None] Registered counter for database nova_cell0 Sep 09 16:22:54.971049 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: INFO dbcounter [None req-23a31d05-a6a7-4ed4-8c5c-3b11d0cc4f76 None None] Registered counter for database nova_cell0 Sep 09 16:22:54.975481 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG oslo_db.sqlalchemy.engines [None req-b42b82ef-d6ed-4b0a-85cf-7571a73e27fb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105533) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 16:22:54.978641 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG oslo_db.sqlalchemy.engines [None req-23a31d05-a6a7-4ed4-8c5c-3b11d0cc4f76 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105534) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 16:22:54.979902 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG dbcounter [-] [105533] Writer thread running {{(pid=105533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 16:22:54.983781 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG dbcounter [-] [105534] Writer thread running {{(pid=105534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 16:22:55.315078 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: WARNING keystonemiddleware.auth_token [None req-b42b82ef-d6ed-4b0a-85cf-7571a73e27fb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 09 16:22:55.316441 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: WARNING keystonemiddleware.auth_token [None req-23a31d05-a6a7-4ed4-8c5c-3b11d0cc4f76 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 09 16:22:55.322330 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: WARNING keystonemiddleware.auth_token [None req-b42b82ef-d6ed-4b0a-85cf-7571a73e27fb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 09 16:22:55.323775 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: WARNING keystonemiddleware.auth_token [None req-23a31d05-a6a7-4ed4-8c5c-3b11d0cc4f76 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 09 16:22:55.662685 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: WARNING keystonemiddleware.auth_token [None req-b42b82ef-d6ed-4b0a-85cf-7571a73e27fb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 09 16:22:55.668716 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: WARNING keystonemiddleware.auth_token [None req-b42b82ef-d6ed-4b0a-85cf-7571a73e27fb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 09 16:22:55.671158 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: WARNING keystonemiddleware.auth_token [None req-23a31d05-a6a7-4ed4-8c5c-3b11d0cc4f76 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 09 16:22:55.674010 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x559b938d79c0 pid: 105533 (default app) Sep 09 16:22:55.676148 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi [None req-b42b82ef-d6ed-4b0a-85cf-7571a73e27fb None None] Calling method '>' {{(pid=105533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:22:55.677105 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: WARNING keystonemiddleware.auth_token [None req-23a31d05-a6a7-4ed4-8c5c-3b11d0cc4f76 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 09 16:22:55.677348 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: INFO nova.api.openstack.requestlog [None req-b42b82ef-d6ed-4b0a-85cf-7571a73e27fb None None] 10.222.0.23 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001772 Sep 09 16:22:55.677754 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: [pid: 105533|app: 0|req: 1/1] 10.222.0.23 () {50 vars in 788 bytes} [Fri Sep 9 16:22:55 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:22:55.682328 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x559b938d79c0 pid: 105534 (default app) Sep 09 16:24:16.976219 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi [None req-b42b82ef-d6ed-4b0a-85cf-7571a73e27fb None None] Calling method '>' {{(pid=105533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:24:16.977962 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: INFO nova.api.openstack.requestlog [None req-b42b82ef-d6ed-4b0a-85cf-7571a73e27fb None None] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002288 Sep 09 16:24:16.983682 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: [pid: 105533|app: 0|req: 2/2] 10.222.0.23 () {54 vars in 931 bytes} [Fri Sep 9 16:24:16 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:24:16.991552 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG dbcounter [-] [105534] Writing DB stats nova_api:SELECT=3 {{(pid=105534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:24:16.992650 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG dbcounter [-] [105534] Writing DB stats nova_cell0:SELECT=3 {{(pid=105534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:24:16.993650 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG dbcounter [-] [105534] Writing DB stats nova_cell1:SELECT=3 {{(pid=105534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:24:16.995775 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG dbcounter [-] [105534] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:24:17.868256 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi [None req-641e099b-83bd-43c4-baae-4704aa653e2a admin admin] Calling method '>' {{(pid=105534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:24:17.900612 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: INFO nova.api.openstack.requestlog [None req-641e099b-83bd-43c4-baae-4704aa653e2a admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.914454 Sep 09 16:24:17.901464 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: [pid: 105534|app: 0|req: 1/3] 10.222.0.23 () {60 vars in 1292 bytes} [Fri Sep 9 16:24:16 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:24:20.488970 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi [None req-b42b82ef-d6ed-4b0a-85cf-7571a73e27fb None None] Calling method '>' {{(pid=105533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:24:20.489977 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: INFO nova.api.openstack.requestlog [None req-b42b82ef-d6ed-4b0a-85cf-7571a73e27fb None None] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 Sep 09 16:24:20.490568 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: [pid: 105533|app: 0|req: 3/4] 10.222.0.23 () {54 vars in 931 bytes} [Fri Sep 9 16:24:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:24:20.937924 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi [None req-224c9c82-aa3d-449e-bee8-45e436e2648a admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "name": "cirros256", "swap": 0, "ram": 256, "vcpus": 1}} {{(pid=105534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:24:20.984847 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: INFO nova.api.openstack.requestlog [None req-224c9c82-aa3d-449e-bee8-45e436e2648a admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.488391 Sep 09 16:24:20.985408 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: [pid: 105534|app: 0|req: 2/5] 10.222.0.23 () {64 vars in 1283 bytes} [Fri Sep 9 16:24:20 2022] POST /compute/v2.1/flavors => generated 407 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 09 16:24:20.999299 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG dbcounter [-] [105533] Writing DB stats nova_api:SELECT=3 {{(pid=105533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:24:21.000119 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG dbcounter [-] [105533] Writing DB stats nova_cell0:SELECT=3 {{(pid=105533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:24:21.001081 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG dbcounter [-] [105533] Writing DB stats nova_cell1:SELECT=3 {{(pid=105533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:24:21.001807 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG dbcounter [-] [105533] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:24:21.203329 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi [None req-0edc30de-d57a-4515-a71f-b4e0c3aefb5f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:24:21.272078 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: INFO nova.api.openstack.requestlog [None req-0edc30de-d57a-4515-a71f-b4e0c3aefb5f admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.278199 Sep 09 16:24:21.272678 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: [pid: 105533|app: 0|req: 4/6] 10.222.0.23 () {64 vars in 1336 bytes} [Fri Sep 9 16:24:20 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:24:23.840037 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi [None req-224c9c82-aa3d-449e-bee8-45e436e2648a admin admin] Calling method '>' {{(pid=105534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:24:23.841038 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: INFO nova.api.openstack.requestlog [None req-224c9c82-aa3d-449e-bee8-45e436e2648a admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001499 Sep 09 16:24:23.841927 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: [pid: 105534|app: 0|req: 3/7] 10.222.0.23 () {54 vars in 931 bytes} [Fri Sep 9 16:24:23 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:24:24.492067 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi [None req-e831a709-285d-4c25-b62b-a372f8581e6f admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "ram": 512, "disk": 5, "id": "d1", "name": "ds512M", "os-flavor-access:is_public": true}} {{(pid=105533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:24:24.534780 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: INFO nova.api.openstack.requestlog [None req-e831a709-285d-4c25-b62b-a372f8581e6f admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.685666 Sep 09 16:24:24.535342 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: [pid: 105533|app: 0|req: 5/8] 10.222.0.23 () {64 vars in 1283 bytes} [Fri Sep 9 16:24:23 2022] POST /compute/v2.1/flavors => generated 404 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 16:24:24.549051 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi [None req-4727b281-5eac-4f69-b575-906c4b57c9da admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:24:24.589692 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: INFO nova.api.openstack.requestlog [None req-4727b281-5eac-4f69-b575-906c4b57c9da admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.044337 Sep 09 16:24:24.590926 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: [pid: 105534|app: 0|req: 4/9] 10.222.0.23 () {64 vars in 1336 bytes} [Fri Sep 9 16:24:24 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:24:27.153339 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi [None req-e831a709-285d-4c25-b62b-a372f8581e6f admin admin] Calling method '>' {{(pid=105533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:24:27.154526 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: INFO nova.api.openstack.requestlog [None req-e831a709-285d-4c25-b62b-a372f8581e6f admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001616 Sep 09 16:24:27.154958 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: [pid: 105533|app: 0|req: 6/10] 10.222.0.23 () {54 vars in 931 bytes} [Fri Sep 9 16:24:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:24:27.574764 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi [None req-8f4f61a2-f524-4f84-8cf0-0c5dccb89373 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 1024, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "disk": 10, "id": "d2", "os-flavor-access:is_public": true, "swap": 0, "name": "ds1G"}} {{(pid=105534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:24:27.595515 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: INFO nova.api.openstack.requestlog [None req-8f4f61a2-f524-4f84-8cf0-0c5dccb89373 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.433960 Sep 09 16:24:27.596298 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: [pid: 105534|app: 0|req: 5/11] 10.222.0.23 () {64 vars in 1283 bytes} [Fri Sep 9 16:24:27 2022] POST /compute/v2.1/flavors => generated 404 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 16:24:27.608201 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi [None req-9b3695b8-e024-4b7f-b9ce-6c1b4602a0cc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:24:27.637749 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: INFO nova.api.openstack.requestlog [None req-9b3695b8-e024-4b7f-b9ce-6c1b4602a0cc admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032763 Sep 09 16:24:27.638569 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: [pid: 105533|app: 0|req: 7/12] 10.222.0.23 () {64 vars in 1336 bytes} [Fri Sep 9 16:24:27 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:24:30.212200 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi [None req-8f4f61a2-f524-4f84-8cf0-0c5dccb89373 admin admin] Calling method '>' {{(pid=105534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:24:30.213844 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: INFO nova.api.openstack.requestlog [None req-8f4f61a2-f524-4f84-8cf0-0c5dccb89373 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002101 Sep 09 16:24:30.218605 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: [pid: 105534|app: 0|req: 6/13] 10.222.0.23 () {54 vars in 931 bytes} [Fri Sep 9 16:24:30 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:24:30.637671 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi [None req-2f6c8009-c822-428e-b86a-91075a719b5f admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "name": "ds2G", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "d3", "ram": 2048, "disk": 10}} {{(pid=105533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:24:30.658430 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: INFO nova.api.openstack.requestlog [None req-2f6c8009-c822-428e-b86a-91075a719b5f admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.437659 Sep 09 16:24:30.659007 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: [pid: 105533|app: 0|req: 8/14] 10.222.0.23 () {64 vars in 1283 bytes} [Fri Sep 9 16:24:30 2022] POST /compute/v2.1/flavors => generated 404 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 16:24:30.671368 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi [None req-2f3ad51c-0666-4994-8886-847e7801acd3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:24:30.699343 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: INFO nova.api.openstack.requestlog [None req-2f3ad51c-0666-4994-8886-847e7801acd3 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031760 Sep 09 16:24:30.700061 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: [pid: 105534|app: 0|req: 7/15] 10.222.0.23 () {64 vars in 1336 bytes} [Fri Sep 9 16:24:30 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:24:33.263291 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi [None req-2f6c8009-c822-428e-b86a-91075a719b5f admin admin] Calling method '>' {{(pid=105533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:24:33.264307 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: INFO nova.api.openstack.requestlog [None req-2f6c8009-c822-428e-b86a-91075a719b5f admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001542 Sep 09 16:24:33.264673 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: [pid: 105533|app: 0|req: 9/16] 10.222.0.23 () {54 vars in 931 bytes} [Fri Sep 9 16:24:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:24:33.688023 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi [None req-bd587b02-db93-4fa9-97fc-8d6be8a0633f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "ram": 4096, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "d4", "disk": 20, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:24:33.708999 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: INFO nova.api.openstack.requestlog [None req-bd587b02-db93-4fa9-97fc-8d6be8a0633f admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.437660 Sep 09 16:24:33.709554 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: [pid: 105534|app: 0|req: 8/17] 10.222.0.23 () {64 vars in 1283 bytes} [Fri Sep 9 16:24:33 2022] POST /compute/v2.1/flavors => generated 404 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 16:24:33.724352 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi [None req-fe8c7315-8388-43af-bf72-82e1faefb0b4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:24:33.757038 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: INFO nova.api.openstack.requestlog [None req-fe8c7315-8388-43af-bf72-82e1faefb0b4 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036871 Sep 09 16:24:33.757632 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: [pid: 105533|app: 0|req: 10/18] 10.222.0.23 () {64 vars in 1336 bytes} [Fri Sep 9 16:24:33 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:24:36.476356 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi [None req-bd587b02-db93-4fa9-97fc-8d6be8a0633f admin admin] Calling method '>' {{(pid=105534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:24:36.477544 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: INFO nova.api.openstack.requestlog [None req-bd587b02-db93-4fa9-97fc-8d6be8a0633f admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001725 Sep 09 16:24:36.478068 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: [pid: 105534|app: 0|req: 9/19] 10.222.0.23 () {54 vars in 931 bytes} [Fri Sep 9 16:24:36 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:24:36.894166 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi [None req-69ec127a-36fa-4939-a3d7-717db851f9f4 admin admin] Calling method '>' {{(pid=105533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:24:36.922224 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: INFO nova.api.openstack.requestlog [None req-69ec127a-36fa-4939-a3d7-717db851f9f4 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.436901 Sep 09 16:24:36.922949 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: [pid: 105533|app: 0|req: 11/20] 10.222.0.23 () {60 vars in 1292 bytes} [Fri Sep 9 16:24:36 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 16:24:39.520352 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi [None req-bd587b02-db93-4fa9-97fc-8d6be8a0633f admin admin] Calling method '>' {{(pid=105534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:24:39.521353 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: INFO nova.api.openstack.requestlog [None req-bd587b02-db93-4fa9-97fc-8d6be8a0633f admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001550 Sep 09 16:24:39.521757 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: [pid: 105534|app: 0|req: 10/21] 10.222.0.23 () {54 vars in 931 bytes} [Fri Sep 9 16:24:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:24:39.932657 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi [None req-fc039def-3f19-4788-aece-2f5e6300082e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 1, "vcpus": 1, "id": "1", "ram": 512, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:24:39.953237 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: INFO nova.api.openstack.requestlog [None req-fc039def-3f19-4788-aece-2f5e6300082e admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.425131 Sep 09 16:24:39.953808 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: [pid: 105533|app: 0|req: 12/22] 10.222.0.23 () {64 vars in 1283 bytes} [Fri Sep 9 16:24:39 2022] POST /compute/v2.1/flavors => generated 402 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 16:24:39.966462 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi [None req-9ee208b4-6170-4c56-94a5-6a66a8d2b902 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:24:39.998044 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: INFO nova.api.openstack.requestlog [None req-9ee208b4-6170-4c56-94a5-6a66a8d2b902 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035182 Sep 09 16:24:39.998840 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: [pid: 105534|app: 0|req: 11/23] 10.222.0.23 () {64 vars in 1333 bytes} [Fri Sep 9 16:24:39 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:24:42.578179 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi [None req-fc039def-3f19-4788-aece-2f5e6300082e admin admin] Calling method '>' {{(pid=105533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:24:42.579232 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: INFO nova.api.openstack.requestlog [None req-fc039def-3f19-4788-aece-2f5e6300082e admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001527 Sep 09 16:24:42.579632 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: [pid: 105533|app: 0|req: 13/24] 10.222.0.23 () {54 vars in 931 bytes} [Fri Sep 9 16:24:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:24:42.991487 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi [None req-db7d1f86-21eb-47eb-af5a-ca4dc6c298ac admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 20, "name": "m1.small", "id": "2", "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "ram": 2048}} {{(pid=105534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:24:43.011089 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: INFO nova.api.openstack.requestlog [None req-db7d1f86-21eb-47eb-af5a-ca4dc6c298ac admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.425309 Sep 09 16:24:43.011628 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: [pid: 105534|app: 0|req: 12/25] 10.222.0.23 () {64 vars in 1283 bytes} [Fri Sep 9 16:24:42 2022] POST /compute/v2.1/flavors => generated 405 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 16:24:43.023990 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi [None req-0237f627-7ee8-4555-b279-09e7784f667c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:24:43.055560 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: INFO nova.api.openstack.requestlog [None req-0237f627-7ee8-4555-b279-09e7784f667c admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035338 Sep 09 16:24:43.056134 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: [pid: 105533|app: 0|req: 14/26] 10.222.0.23 () {64 vars in 1333 bytes} [Fri Sep 9 16:24:43 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:24:45.626356 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi [None req-db7d1f86-21eb-47eb-af5a-ca4dc6c298ac admin admin] Calling method '>' {{(pid=105534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:24:45.627427 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: INFO nova.api.openstack.requestlog [None req-db7d1f86-21eb-47eb-af5a-ca4dc6c298ac admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Sep 09 16:24:45.628135 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: [pid: 105534|app: 0|req: 13/27] 10.222.0.23 () {54 vars in 931 bytes} [Fri Sep 9 16:24:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:24:46.092953 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi [None req-907206b4-8b5a-4551-8862-360ed05f3fda admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "disk": 40, "ram": 4096, "name": "m1.medium", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 2, "os-flavor-access:is_public": true}} {{(pid=105533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:24:46.114237 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: INFO nova.api.openstack.requestlog [None req-907206b4-8b5a-4551-8862-360ed05f3fda admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.480320 Sep 09 16:24:46.114933 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: [pid: 105533|app: 0|req: 15/28] 10.222.0.23 () {64 vars in 1283 bytes} [Fri Sep 9 16:24:45 2022] POST /compute/v2.1/flavors => generated 406 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 16:24:46.127658 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi [None req-44fb5ece-195e-4b21-bfd3-f685eeab0c08 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:24:46.155924 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: INFO nova.api.openstack.requestlog [None req-44fb5ece-195e-4b21-bfd3-f685eeab0c08 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032205 Sep 09 16:24:46.156765 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: [pid: 105534|app: 0|req: 14/29] 10.222.0.23 () {64 vars in 1333 bytes} [Fri Sep 9 16:24:46 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:24:48.795790 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi [None req-907206b4-8b5a-4551-8862-360ed05f3fda admin admin] Calling method '>' {{(pid=105533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:24:48.796841 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: INFO nova.api.openstack.requestlog [None req-907206b4-8b5a-4551-8862-360ed05f3fda admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Sep 09 16:24:48.797466 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: [pid: 105533|app: 0|req: 16/30] 10.222.0.23 () {54 vars in 931 bytes} [Fri Sep 9 16:24:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:24:49.258307 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi [None req-afd2f766-7152-45ee-904d-2c1883388c79 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "name": "m1.large", "os-flavor-access:is_public": true, "id": "4", "swap": 0, "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192, "rxtx_factor": 1.0}} {{(pid=105534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:24:49.264888 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG dbcounter [-] [105534] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=105534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:24:49.282774 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: INFO nova.api.openstack.requestlog [None req-afd2f766-7152-45ee-904d-2c1883388c79 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.478344 Sep 09 16:24:49.283623 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: [pid: 105534|app: 0|req: 15/31] 10.222.0.23 () {64 vars in 1283 bytes} [Fri Sep 9 16:24:48 2022] POST /compute/v2.1/flavors => generated 405 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 16:24:49.308653 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi [None req-ac9f6528-c08e-43b2-aed1-1cfcba3f041c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:24:49.341125 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: INFO nova.api.openstack.requestlog [None req-ac9f6528-c08e-43b2-aed1-1cfcba3f041c admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.049123 Sep 09 16:24:49.342435 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: [pid: 105533|app: 0|req: 17/32] 10.222.0.23 () {64 vars in 1333 bytes} [Fri Sep 9 16:24:49 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:24:51.913467 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi [None req-afd2f766-7152-45ee-904d-2c1883388c79 admin admin] Calling method '>' {{(pid=105534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:24:51.914478 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: INFO nova.api.openstack.requestlog [None req-afd2f766-7152-45ee-904d-2c1883388c79 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Sep 09 16:24:51.914907 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: [pid: 105534|app: 0|req: 16/33] 10.222.0.23 () {54 vars in 931 bytes} [Fri Sep 9 16:24:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:24:52.347540 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi [None req-894ec960-a2d6-42ba-9f5c-0d037b5e411d admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 8, "swap": 0, "os-flavor-access:is_public": true, "name": "m1.xlarge", "ram": 16384, "rxtx_factor": 1.0}} {{(pid=105533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:24:52.359058 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG dbcounter [-] [105533] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=105533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:24:52.372593 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: INFO nova.api.openstack.requestlog [None req-894ec960-a2d6-42ba-9f5c-0d037b5e411d admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.451407 Sep 09 16:24:52.373318 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: [pid: 105533|app: 0|req: 18/34] 10.222.0.23 () {64 vars in 1283 bytes} [Fri Sep 9 16:24:51 2022] POST /compute/v2.1/flavors => generated 408 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 16:24:52.385298 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi [None req-867bb315-b0a0-46de-92aa-dca06e7be9ad admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:24:52.410651 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: INFO nova.api.openstack.requestlog [None req-867bb315-b0a0-46de-92aa-dca06e7be9ad admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028900 Sep 09 16:24:52.422652 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: [pid: 105534|app: 0|req: 17/35] 10.222.0.23 () {64 vars in 1333 bytes} [Fri Sep 9 16:24:52 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:25:12.599984 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi [None req-894ec960-a2d6-42ba-9f5c-0d037b5e411d admin admin] Calling method '>' {{(pid=105533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:25:12.600995 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: INFO nova.api.openstack.requestlog [None req-894ec960-a2d6-42ba-9f5c-0d037b5e411d admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Sep 09 16:25:12.601392 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: [pid: 105533|app: 0|req: 19/36] 10.222.0.23 () {54 vars in 931 bytes} [Fri Sep 9 16:25:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:25:12.615431 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG dbcounter [-] [105534] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=105534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:25:13.151074 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi [None req-0c52b6f2-35d9-4cf0-ad71-6ddef8cf3d87 admin admin] Calling method '>' {{(pid=105534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:25:13.169613 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: INFO nova.api.openstack.requestlog [None req-0c52b6f2-35d9-4cf0-ad71-6ddef8cf3d87 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.561607 Sep 09 16:25:13.170147 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: [pid: 105534|app: 0|req: 18/37] 10.222.0.23 () {60 vars in 1292 bytes} [Fri Sep 9 16:25:12 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 16:25:14.480329 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi [None req-894ec960-a2d6-42ba-9f5c-0d037b5e411d admin admin] Calling method '>' {{(pid=105533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:25:14.481327 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: INFO nova.api.openstack.requestlog [None req-894ec960-a2d6-42ba-9f5c-0d037b5e411d admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Sep 09 16:25:14.481715 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: [pid: 105533|app: 0|req: 20/38] 10.222.0.23 () {56 vars in 1074 bytes} [Fri Sep 9 16:25:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:25:15.050447 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi [None req-9c8b8c3f-f638-423c-837e-4d77a970ee11 admin admin] Calling method '>' {{(pid=105534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:25:15.056504 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: INFO nova.api.openstack.wsgi [None req-9c8b8c3f-f638-423c-837e-4d77a970ee11 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 09 16:25:15.059804 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi [None req-9c8b8c3f-f638-423c-837e-4d77a970ee11 admin admin] Request method failure captured: Sep 09 16:25:15.059804 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 09 16:25:15.059804 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: Accept: application/json Sep 09 16:25:15.059804 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: Accept-Encoding: gzip, deflate Sep 09 16:25:15.059804 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: Connection: keep-alive Sep 09 16:25:15.059804 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: Content-Length: 0 Sep 09 16:25:15.059804 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: Host: 10.222.0.23 Sep 09 16:25:15.059804 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: Openstack-Api-Version: compute 2.92 Sep 09 16:25:15.059804 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: Openstack-System-Scope: None Sep 09 16:25:15.059804 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: User-Agent: python-novaclient Sep 09 16:25:15.059804 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: X-Auth-Token: gAAAAABjG2jqQDkUqUOWpS3TB0k3z7_9Mb2RuUfKPEDVImavisVn2i2m_Jr7CdZWSp11lvMHNEkL9iSG2xIL32a4qsLqHxW9kaCrDjmG-OJmZx35B4KIAfZSMqNBVBWjeZzFU24ZxRz50jBMhU45l2Af5mmdkqqGlM_zJEPV-3OZsKXN4I3o5t4 Sep 09 16:25:15.059804 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: X-Domain-Id: None Sep 09 16:25:15.059804 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: X-Domain-Name: None Sep 09 16:25:15.059804 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: X-Identity-Status: Confirmed Sep 09 16:25:15.059804 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: X-Is-Admin-Project: True Sep 09 16:25:15.059804 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: X-Openstack-Nova-Api-Version: 2.92 Sep 09 16:25:15.059804 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: X-Project-Domain-Id: default Sep 09 16:25:15.059804 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: X-Project-Domain-Name: Default Sep 09 16:25:15.059804 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: X-Project-Id: f5e628b418b44cb0b8fcf5460ded8ac8 Sep 09 16:25:15.059804 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: X-Project-Name: admin Sep 09 16:25:15.059804 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: X-Role: admin,member,reader Sep 09 16:25:15.059804 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: X-Roles: admin,member,reader Sep 09 16:25:15.061383 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f5e628b418b44cb0b8fcf5460ded8ac8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f5e628b418b44cb0b8fcf5460ded8ac8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f5e628b418b44cb0b8fcf5460ded8ac8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f5e628b418b44cb0b8fcf5460ded8ac8"}]}] Sep 09 16:25:15.061383 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: X-Tenant: admin Sep 09 16:25:15.061383 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: X-Tenant-Id: f5e628b418b44cb0b8fcf5460ded8ac8 Sep 09 16:25:15.061383 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: X-Tenant-Name: admin Sep 09 16:25:15.061383 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: X-User: admin Sep 09 16:25:15.061383 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: X-User-Domain-Id: default Sep 09 16:25:15.061383 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: X-User-Domain-Name: Default Sep 09 16:25:15.061383 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: X-User-Id: 94cbbd1503324af1af6df581aea570b9 Sep 09 16:25:15.061383 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: X-User-Name: admin Sep 09 16:25:15.061383 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: method: > Sep 09 16:25:15.061383 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: exception: Flavor 42 could not be found. Sep 09 16:25:15.061383 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: action_args: {'id': '42'} Sep 09 16:25:15.061383 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: {{(pid=105534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 16:25:15.061383 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:25:15.062482 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 09 16:25:15.062482 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 09 16:25:15.062482 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 09 16:25:15.062482 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 09 16:25:15.062482 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 09 16:25:15.062482 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 09 16:25:15.062482 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 09 16:25:15.062482 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 09 16:25:15.062482 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 09 16:25:15.062482 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 16:25:15.062482 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 09 16:25:15.062482 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 09 16:25:15.062482 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 09 16:25:15.062482 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi Sep 09 16:25:15.062482 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 16:25:15.062482 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi Sep 09 16:25:15.062482 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:25:15.062482 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 16:25:15.062482 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 16:25:15.063898 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 16:25:15.063898 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 16:25:15.063898 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 16:25:15.063898 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 16:25:15.063898 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 09 16:25:15.063898 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 09 16:25:15.063898 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 09 16:25:15.063898 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi Sep 09 16:25:15.063898 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 16:25:15.063898 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi Sep 09 16:25:15.063898 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:25:15.063898 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 16:25:15.063898 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 16:25:15.063898 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 16:25:15.063898 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 16:25:15.063898 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 09 16:25:15.063898 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi Sep 09 16:25:15.063898 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi [None req-9c8b8c3f-f638-423c-837e-4d77a970ee11 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105534) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 16:25:15.065164 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: INFO nova.api.openstack.requestlog [None req-9c8b8c3f-f638-423c-837e-4d77a970ee11 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.432901 Sep 09 16:25:15.065164 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: [pid: 105534|app: 0|req: 19/39] 10.222.0.23 () {60 vars in 1190 bytes} [Fri Sep 9 16:25:14 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 434 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 09 16:25:15.071864 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi [None req-5e02c046-a987-49cd-900d-116de89aed1c admin admin] Calling method '>' {{(pid=105533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:25:15.094873 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: INFO nova.api.openstack.requestlog [None req-5e02c046-a987-49cd-900d-116de89aed1c admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026845 Sep 09 16:25:15.095414 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: [pid: 105533|app: 0|req: 21/40] 10.222.0.23 () {60 vars in 1210 bytes} [Fri Sep 9 16:25:15 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 16:25:15.106903 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi [None req-0aee2cae-f19b-4fb3-9e1a-940807f1264c admin admin] Calling method '>' {{(pid=105534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:25:15.128921 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: INFO nova.api.openstack.requestlog [None req-0aee2cae-f19b-4fb3-9e1a-940807f1264c admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026822 Sep 09 16:25:15.129449 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: [pid: 105534|app: 0|req: 20/41] 10.222.0.23 () {60 vars in 1210 bytes} [Fri Sep 9 16:25:15 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 16:25:15.139719 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi [None req-1ff2c98d-940d-474d-a3a0-7e9f43a8b378 admin admin] Calling method '>' {{(pid=105533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:25:15.145486 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: INFO nova.api.openstack.wsgi [None req-1ff2c98d-940d-474d-a3a0-7e9f43a8b378 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 09 16:25:15.148822 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi [None req-1ff2c98d-940d-474d-a3a0-7e9f43a8b378 admin admin] Request method failure captured: Sep 09 16:25:15.148822 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 09 16:25:15.148822 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: Accept: application/json Sep 09 16:25:15.148822 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: Accept-Encoding: gzip, deflate Sep 09 16:25:15.148822 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: Connection: keep-alive Sep 09 16:25:15.148822 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: Content-Length: 0 Sep 09 16:25:15.148822 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: Host: 10.222.0.23 Sep 09 16:25:15.148822 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: Openstack-Api-Version: compute 2.92 Sep 09 16:25:15.148822 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: Openstack-System-Scope: None Sep 09 16:25:15.148822 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: User-Agent: python-novaclient Sep 09 16:25:15.148822 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: X-Auth-Token: gAAAAABjG2jqQDkUqUOWpS3TB0k3z7_9Mb2RuUfKPEDVImavisVn2i2m_Jr7CdZWSp11lvMHNEkL9iSG2xIL32a4qsLqHxW9kaCrDjmG-OJmZx35B4KIAfZSMqNBVBWjeZzFU24ZxRz50jBMhU45l2Af5mmdkqqGlM_zJEPV-3OZsKXN4I3o5t4 Sep 09 16:25:15.148822 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: X-Domain-Id: None Sep 09 16:25:15.148822 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: X-Domain-Name: None Sep 09 16:25:15.148822 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: X-Identity-Status: Confirmed Sep 09 16:25:15.148822 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: X-Is-Admin-Project: True Sep 09 16:25:15.148822 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: X-Openstack-Nova-Api-Version: 2.92 Sep 09 16:25:15.148822 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: X-Project-Domain-Id: default Sep 09 16:25:15.148822 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: X-Project-Domain-Name: Default Sep 09 16:25:15.148822 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: X-Project-Id: f5e628b418b44cb0b8fcf5460ded8ac8 Sep 09 16:25:15.148822 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: X-Project-Name: admin Sep 09 16:25:15.148822 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: X-Role: admin,member,reader Sep 09 16:25:15.148822 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: X-Roles: admin,member,reader Sep 09 16:25:15.150139 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f5e628b418b44cb0b8fcf5460ded8ac8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f5e628b418b44cb0b8fcf5460ded8ac8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f5e628b418b44cb0b8fcf5460ded8ac8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f5e628b418b44cb0b8fcf5460ded8ac8"}]}] Sep 09 16:25:15.150139 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: X-Tenant: admin Sep 09 16:25:15.150139 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: X-Tenant-Id: f5e628b418b44cb0b8fcf5460ded8ac8 Sep 09 16:25:15.150139 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: X-Tenant-Name: admin Sep 09 16:25:15.150139 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: X-User: admin Sep 09 16:25:15.150139 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: X-User-Domain-Id: default Sep 09 16:25:15.150139 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: X-User-Domain-Name: Default Sep 09 16:25:15.150139 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: X-User-Id: 94cbbd1503324af1af6df581aea570b9 Sep 09 16:25:15.150139 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: X-User-Name: admin Sep 09 16:25:15.150139 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: method: > Sep 09 16:25:15.150139 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: exception: Flavor 42 could not be found. Sep 09 16:25:15.150139 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: action_args: {'id': '42'} Sep 09 16:25:15.150139 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: {{(pid=105533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 16:25:15.150139 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:25:15.150952 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 09 16:25:15.150952 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 09 16:25:15.150952 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 09 16:25:15.150952 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 09 16:25:15.150952 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 09 16:25:15.150952 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 09 16:25:15.150952 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 09 16:25:15.150952 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 09 16:25:15.150952 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 09 16:25:15.150952 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 16:25:15.150952 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 09 16:25:15.150952 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 09 16:25:15.150952 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 09 16:25:15.150952 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: ERROR nova.api.openstack.wsgi Sep 09 16:25:15.150952 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 16:25:15.150952 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: ERROR nova.api.openstack.wsgi Sep 09 16:25:15.150952 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:25:15.150952 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 16:25:15.150952 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 16:25:15.151962 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 16:25:15.151962 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 16:25:15.151962 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 16:25:15.151962 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 16:25:15.151962 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 09 16:25:15.151962 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 09 16:25:15.151962 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 09 16:25:15.151962 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: ERROR nova.api.openstack.wsgi Sep 09 16:25:15.151962 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 16:25:15.151962 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: ERROR nova.api.openstack.wsgi Sep 09 16:25:15.151962 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:25:15.151962 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 16:25:15.151962 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 16:25:15.151962 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 16:25:15.151962 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 16:25:15.151962 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 09 16:25:15.151962 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: ERROR nova.api.openstack.wsgi Sep 09 16:25:15.151962 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi [None req-1ff2c98d-940d-474d-a3a0-7e9f43a8b378 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105533) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 16:25:15.153199 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: INFO nova.api.openstack.requestlog [None req-1ff2c98d-940d-474d-a3a0-7e9f43a8b378 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014825 Sep 09 16:25:15.153199 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: [pid: 105533|app: 0|req: 22/42] 10.222.0.23 () {60 vars in 1190 bytes} [Fri Sep 9 16:25:15 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 09 16:25:16.372154 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi [None req-0aee2cae-f19b-4fb3-9e1a-940807f1264c admin admin] Calling method '>' {{(pid=105534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:25:16.373166 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: INFO nova.api.openstack.requestlog [None req-0aee2cae-f19b-4fb3-9e1a-940807f1264c admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Sep 09 16:25:16.373561 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: [pid: 105534|app: 0|req: 21/43] 10.222.0.23 () {56 vars in 1074 bytes} [Fri Sep 9 16:25:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:25:16.932834 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi [None req-77319bb3-1632-4ec2-9c49-74eed65e4c74 admin admin] Calling method '>' {{(pid=105533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:25:16.938060 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: INFO nova.api.openstack.wsgi [None req-77319bb3-1632-4ec2-9c49-74eed65e4c74 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 09 16:25:16.939959 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi [None req-77319bb3-1632-4ec2-9c49-74eed65e4c74 admin admin] Request method failure captured: Sep 09 16:25:16.939959 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 09 16:25:16.939959 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: Accept: application/json Sep 09 16:25:16.939959 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: Accept-Encoding: gzip, deflate Sep 09 16:25:16.939959 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: Connection: keep-alive Sep 09 16:25:16.939959 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: Content-Length: 0 Sep 09 16:25:16.939959 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: Host: 10.222.0.23 Sep 09 16:25:16.939959 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: Openstack-Api-Version: compute 2.92 Sep 09 16:25:16.939959 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: Openstack-System-Scope: None Sep 09 16:25:16.939959 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: User-Agent: python-novaclient Sep 09 16:25:16.939959 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: X-Auth-Token: gAAAAABjG2jszMvKCweZ5q-vpPBfCK3vNeowUNhoHDvnBTLoTgmFYf3Yq-aNG75TpKKUlKahCej1p7nx0yQw5_LX52YO8WSM1pNYYtHpmaLrpt-glV6Y3YoHNn3-Nj1Pm2Hy3ufZdb74AJUEvObB_N7zqODNGw06NOxYpNPzC22sfdktPRDaCMM Sep 09 16:25:16.939959 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: X-Domain-Id: None Sep 09 16:25:16.939959 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: X-Domain-Name: None Sep 09 16:25:16.939959 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: X-Identity-Status: Confirmed Sep 09 16:25:16.939959 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: X-Is-Admin-Project: True Sep 09 16:25:16.939959 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: X-Openstack-Nova-Api-Version: 2.92 Sep 09 16:25:16.939959 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: X-Project-Domain-Id: default Sep 09 16:25:16.939959 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: X-Project-Domain-Name: Default Sep 09 16:25:16.939959 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: X-Project-Id: f5e628b418b44cb0b8fcf5460ded8ac8 Sep 09 16:25:16.939959 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: X-Project-Name: admin Sep 09 16:25:16.939959 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: X-Role: admin,member,reader Sep 09 16:25:16.939959 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: X-Roles: admin,member,reader Sep 09 16:25:16.941595 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f5e628b418b44cb0b8fcf5460ded8ac8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f5e628b418b44cb0b8fcf5460ded8ac8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f5e628b418b44cb0b8fcf5460ded8ac8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f5e628b418b44cb0b8fcf5460ded8ac8"}]}] Sep 09 16:25:16.941595 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: X-Tenant: admin Sep 09 16:25:16.941595 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: X-Tenant-Id: f5e628b418b44cb0b8fcf5460ded8ac8 Sep 09 16:25:16.941595 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: X-Tenant-Name: admin Sep 09 16:25:16.941595 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: X-User: admin Sep 09 16:25:16.941595 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: X-User-Domain-Id: default Sep 09 16:25:16.941595 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: X-User-Domain-Name: Default Sep 09 16:25:16.941595 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: X-User-Id: 94cbbd1503324af1af6df581aea570b9 Sep 09 16:25:16.941595 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: X-User-Name: admin Sep 09 16:25:16.941595 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: method: > Sep 09 16:25:16.941595 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: exception: Flavor 84 could not be found. Sep 09 16:25:16.941595 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: action_args: {'id': '84'} Sep 09 16:25:16.941595 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: {{(pid=105533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 16:25:16.941595 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:25:16.942491 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 09 16:25:16.942491 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 09 16:25:16.942491 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 09 16:25:16.942491 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 09 16:25:16.942491 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 09 16:25:16.942491 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 09 16:25:16.942491 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 09 16:25:16.942491 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 09 16:25:16.942491 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 09 16:25:16.942491 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 16:25:16.942491 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 09 16:25:16.942491 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 09 16:25:16.942491 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 09 16:25:16.942491 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: ERROR nova.api.openstack.wsgi Sep 09 16:25:16.942491 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 16:25:16.942491 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: ERROR nova.api.openstack.wsgi Sep 09 16:25:16.942491 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:25:16.942491 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 16:25:16.942491 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 16:25:16.944242 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 16:25:16.944242 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 16:25:16.944242 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 16:25:16.944242 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 16:25:16.944242 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 09 16:25:16.944242 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 09 16:25:16.944242 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 09 16:25:16.944242 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: ERROR nova.api.openstack.wsgi Sep 09 16:25:16.944242 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 16:25:16.944242 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: ERROR nova.api.openstack.wsgi Sep 09 16:25:16.944242 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:25:16.944242 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 16:25:16.944242 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 16:25:16.944242 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 16:25:16.944242 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 16:25:16.944242 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 09 16:25:16.944242 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: ERROR nova.api.openstack.wsgi Sep 09 16:25:16.944242 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi [None req-77319bb3-1632-4ec2-9c49-74eed65e4c74 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105533) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 16:25:16.945488 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: INFO nova.api.openstack.requestlog [None req-77319bb3-1632-4ec2-9c49-74eed65e4c74 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.433230 Sep 09 16:25:16.945488 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: [pid: 105533|app: 0|req: 23/44] 10.222.0.23 () {60 vars in 1190 bytes} [Fri Sep 9 16:25:16 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 435 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 09 16:25:16.951783 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi [None req-ceaa188b-1266-4e78-ba9d-5d5d6385ab27 admin admin] Calling method '>' {{(pid=105534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:25:16.966935 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: INFO nova.api.openstack.requestlog [None req-ceaa188b-1266-4e78-ba9d-5d5d6385ab27 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018876 Sep 09 16:25:16.967618 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: [pid: 105534|app: 0|req: 22/45] 10.222.0.23 () {60 vars in 1210 bytes} [Fri Sep 9 16:25:16 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 16:25:16.977088 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi [None req-80e7dcbb-48dc-4621-baab-a369ba5faa9c admin admin] Calling method '>' {{(pid=105533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:25:16.992816 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: INFO nova.api.openstack.requestlog [None req-80e7dcbb-48dc-4621-baab-a369ba5faa9c admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019344 Sep 09 16:25:16.993307 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: [pid: 105533|app: 0|req: 24/46] 10.222.0.23 () {60 vars in 1210 bytes} [Fri Sep 9 16:25:16 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 16:25:17.002444 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi [None req-f477d791-7ba3-41b9-98d8-b3b620e26b1b admin admin] Calling method '>' {{(pid=105534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:25:17.007829 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: INFO nova.api.openstack.wsgi [None req-f477d791-7ba3-41b9-98d8-b3b620e26b1b admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 09 16:25:17.009326 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi [None req-f477d791-7ba3-41b9-98d8-b3b620e26b1b admin admin] Request method failure captured: Sep 09 16:25:17.009326 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 09 16:25:17.009326 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: Accept: application/json Sep 09 16:25:17.009326 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: Accept-Encoding: gzip, deflate Sep 09 16:25:17.009326 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: Connection: keep-alive Sep 09 16:25:17.009326 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: Content-Length: 0 Sep 09 16:25:17.009326 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: Host: 10.222.0.23 Sep 09 16:25:17.009326 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: Openstack-Api-Version: compute 2.92 Sep 09 16:25:17.009326 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: Openstack-System-Scope: None Sep 09 16:25:17.009326 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: User-Agent: python-novaclient Sep 09 16:25:17.009326 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: X-Auth-Token: gAAAAABjG2jszMvKCweZ5q-vpPBfCK3vNeowUNhoHDvnBTLoTgmFYf3Yq-aNG75TpKKUlKahCej1p7nx0yQw5_LX52YO8WSM1pNYYtHpmaLrpt-glV6Y3YoHNn3-Nj1Pm2Hy3ufZdb74AJUEvObB_N7zqODNGw06NOxYpNPzC22sfdktPRDaCMM Sep 09 16:25:17.009326 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: X-Domain-Id: None Sep 09 16:25:17.009326 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: X-Domain-Name: None Sep 09 16:25:17.009326 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: X-Identity-Status: Confirmed Sep 09 16:25:17.009326 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: X-Is-Admin-Project: True Sep 09 16:25:17.009326 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: X-Openstack-Nova-Api-Version: 2.92 Sep 09 16:25:17.009326 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: X-Project-Domain-Id: default Sep 09 16:25:17.009326 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: X-Project-Domain-Name: Default Sep 09 16:25:17.009326 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: X-Project-Id: f5e628b418b44cb0b8fcf5460ded8ac8 Sep 09 16:25:17.009326 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: X-Project-Name: admin Sep 09 16:25:17.009326 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: X-Role: admin,member,reader Sep 09 16:25:17.009326 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: X-Roles: admin,member,reader Sep 09 16:25:17.010778 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f5e628b418b44cb0b8fcf5460ded8ac8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f5e628b418b44cb0b8fcf5460ded8ac8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f5e628b418b44cb0b8fcf5460ded8ac8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f5e628b418b44cb0b8fcf5460ded8ac8"}]}] Sep 09 16:25:17.010778 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: X-Tenant: admin Sep 09 16:25:17.010778 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: X-Tenant-Id: f5e628b418b44cb0b8fcf5460ded8ac8 Sep 09 16:25:17.010778 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: X-Tenant-Name: admin Sep 09 16:25:17.010778 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: X-User: admin Sep 09 16:25:17.010778 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: X-User-Domain-Id: default Sep 09 16:25:17.010778 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: X-User-Domain-Name: Default Sep 09 16:25:17.010778 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: X-User-Id: 94cbbd1503324af1af6df581aea570b9 Sep 09 16:25:17.010778 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: X-User-Name: admin Sep 09 16:25:17.010778 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: method: > Sep 09 16:25:17.010778 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: exception: Flavor 84 could not be found. Sep 09 16:25:17.010778 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: action_args: {'id': '84'} Sep 09 16:25:17.010778 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: {{(pid=105534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 16:25:17.010778 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:25:17.012661 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 09 16:25:17.012661 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 09 16:25:17.012661 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 09 16:25:17.012661 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 09 16:25:17.012661 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 09 16:25:17.012661 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 09 16:25:17.012661 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 09 16:25:17.012661 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 09 16:25:17.012661 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 09 16:25:17.012661 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 16:25:17.012661 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 09 16:25:17.012661 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 09 16:25:17.012661 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 09 16:25:17.012661 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi Sep 09 16:25:17.012661 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 16:25:17.012661 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi Sep 09 16:25:17.012661 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:25:17.012661 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 16:25:17.012661 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 16:25:17.013940 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 16:25:17.013940 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 16:25:17.013940 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 16:25:17.013940 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 16:25:17.013940 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 09 16:25:17.013940 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 09 16:25:17.013940 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 09 16:25:17.013940 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi Sep 09 16:25:17.013940 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 16:25:17.013940 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi Sep 09 16:25:17.013940 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:25:17.013940 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 16:25:17.013940 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 16:25:17.013940 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 16:25:17.013940 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 16:25:17.013940 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 09 16:25:17.013940 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi Sep 09 16:25:17.013940 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi [None req-f477d791-7ba3-41b9-98d8-b3b620e26b1b admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105534) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 16:25:17.015135 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: INFO nova.api.openstack.requestlog [None req-f477d791-7ba3-41b9-98d8-b3b620e26b1b admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011823 Sep 09 16:25:17.015135 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: [pid: 105534|app: 0|req: 23/47] 10.222.0.23 () {60 vars in 1190 bytes} [Fri Sep 9 16:25:16 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 09 16:25:18.286555 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi [None req-80e7dcbb-48dc-4621-baab-a369ba5faa9c admin admin] Calling method '>' {{(pid=105533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:25:18.287671 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: INFO nova.api.openstack.requestlog [None req-80e7dcbb-48dc-4621-baab-a369ba5faa9c admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001754 Sep 09 16:25:18.288192 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: [pid: 105533|app: 0|req: 25/48] 10.222.0.23 () {56 vars in 1074 bytes} [Fri Sep 9 16:25:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:25:18.838910 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi [None req-3790ae4a-2199-42f9-967b-88da33431408 admin admin] Calling method '>' {{(pid=105534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:25:18.845221 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: INFO nova.api.openstack.wsgi [None req-3790ae4a-2199-42f9-967b-88da33431408 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 09 16:25:18.847113 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi [None req-3790ae4a-2199-42f9-967b-88da33431408 admin admin] Request method failure captured: Sep 09 16:25:18.847113 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 09 16:25:18.847113 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: Accept: application/json Sep 09 16:25:18.847113 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: Accept-Encoding: gzip, deflate Sep 09 16:25:18.847113 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: Connection: keep-alive Sep 09 16:25:18.847113 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: Content-Length: 0 Sep 09 16:25:18.847113 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: Host: 10.222.0.23 Sep 09 16:25:18.847113 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: Openstack-Api-Version: compute 2.92 Sep 09 16:25:18.847113 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: Openstack-System-Scope: None Sep 09 16:25:18.847113 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: User-Agent: python-novaclient Sep 09 16:25:18.847113 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: X-Auth-Token: gAAAAABjG2jucm0nvRjvg-vFrWpDzbce0Jwkzm-M0q2J7GiL8NfBEfRcGKqxs6vP6eLu6xxSuWt-aEnAvvAwIFFhW5CqqqZXGYrUQsG7eWsRqmaQH45HZjMCTUTiY5V_UrFxk8JKqxgf_sF-Dz_Vmo1WkjWXR7EatTkcSj0tYWRJIBezI0MACbQ Sep 09 16:25:18.847113 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: X-Domain-Id: None Sep 09 16:25:18.847113 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: X-Domain-Name: None Sep 09 16:25:18.847113 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: X-Identity-Status: Confirmed Sep 09 16:25:18.847113 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: X-Is-Admin-Project: True Sep 09 16:25:18.847113 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: X-Openstack-Nova-Api-Version: 2.92 Sep 09 16:25:18.847113 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: X-Project-Domain-Id: default Sep 09 16:25:18.847113 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: X-Project-Domain-Name: Default Sep 09 16:25:18.847113 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: X-Project-Id: f5e628b418b44cb0b8fcf5460ded8ac8 Sep 09 16:25:18.847113 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: X-Project-Name: admin Sep 09 16:25:18.847113 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: X-Role: admin,member,reader Sep 09 16:25:18.847113 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: X-Roles: admin,member,reader Sep 09 16:25:18.848482 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f5e628b418b44cb0b8fcf5460ded8ac8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f5e628b418b44cb0b8fcf5460ded8ac8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f5e628b418b44cb0b8fcf5460ded8ac8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f5e628b418b44cb0b8fcf5460ded8ac8"}]}] Sep 09 16:25:18.848482 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: X-Tenant: admin Sep 09 16:25:18.848482 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: X-Tenant-Id: f5e628b418b44cb0b8fcf5460ded8ac8 Sep 09 16:25:18.848482 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: X-Tenant-Name: admin Sep 09 16:25:18.848482 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: X-User: admin Sep 09 16:25:18.848482 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: X-User-Domain-Id: default Sep 09 16:25:18.848482 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: X-User-Domain-Name: Default Sep 09 16:25:18.848482 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: X-User-Id: 94cbbd1503324af1af6df581aea570b9 Sep 09 16:25:18.848482 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: X-User-Name: admin Sep 09 16:25:18.848482 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: method: > Sep 09 16:25:18.848482 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: exception: Flavor 451 could not be found. Sep 09 16:25:18.848482 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: action_args: {'id': '451'} Sep 09 16:25:18.848482 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: {{(pid=105534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 16:25:18.848482 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:25:18.849273 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 09 16:25:18.849273 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 09 16:25:18.849273 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 09 16:25:18.849273 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 09 16:25:18.849273 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 09 16:25:18.849273 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 09 16:25:18.849273 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 09 16:25:18.849273 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 09 16:25:18.849273 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 09 16:25:18.849273 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 16:25:18.849273 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 09 16:25:18.849273 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 09 16:25:18.849273 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 09 16:25:18.849273 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi Sep 09 16:25:18.849273 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 16:25:18.849273 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi Sep 09 16:25:18.849273 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:25:18.849273 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 16:25:18.849273 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 16:25:18.850575 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 16:25:18.850575 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 16:25:18.850575 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 16:25:18.850575 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 16:25:18.850575 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 09 16:25:18.850575 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 09 16:25:18.850575 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 09 16:25:18.850575 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi Sep 09 16:25:18.850575 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 16:25:18.850575 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi Sep 09 16:25:18.850575 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:25:18.850575 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 16:25:18.850575 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 16:25:18.850575 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 16:25:18.850575 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 16:25:18.850575 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 09 16:25:18.850575 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi Sep 09 16:25:18.850575 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi [None req-3790ae4a-2199-42f9-967b-88da33431408 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105534) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 16:25:18.851720 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: INFO nova.api.openstack.requestlog [None req-3790ae4a-2199-42f9-967b-88da33431408 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.416971 Sep 09 16:25:18.851720 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: [pid: 105534|app: 0|req: 24/49] 10.222.0.23 () {60 vars in 1193 bytes} [Fri Sep 9 16:25:18 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 419 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 09 16:25:18.858297 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi [None req-c989b997-d7e8-483c-a63a-46571e887aab admin admin] Calling method '>' {{(pid=105533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:25:18.873350 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: INFO nova.api.openstack.requestlog [None req-c989b997-d7e8-483c-a63a-46571e887aab admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018777 Sep 09 16:25:18.873875 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: [pid: 105533|app: 0|req: 26/50] 10.222.0.23 () {60 vars in 1210 bytes} [Fri Sep 9 16:25:18 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 16:25:18.883343 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi [None req-ed913e82-6259-4fe1-b2f5-06119f535333 admin admin] Calling method '>' {{(pid=105534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:25:18.898363 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: INFO nova.api.openstack.requestlog [None req-ed913e82-6259-4fe1-b2f5-06119f535333 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018585 Sep 09 16:25:18.898908 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: [pid: 105534|app: 0|req: 25/51] 10.222.0.23 () {60 vars in 1210 bytes} [Fri Sep 9 16:25:18 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 16:25:18.910682 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi [None req-581fd0fc-42f0-43a7-9f33-a9ec83d0cdbe admin admin] Calling method '>' {{(pid=105533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:25:18.918133 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: INFO nova.api.openstack.wsgi [None req-581fd0fc-42f0-43a7-9f33-a9ec83d0cdbe admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 09 16:25:18.920618 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi [None req-581fd0fc-42f0-43a7-9f33-a9ec83d0cdbe admin admin] Request method failure captured: Sep 09 16:25:18.920618 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 09 16:25:18.920618 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: Accept: application/json Sep 09 16:25:18.920618 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: Accept-Encoding: gzip, deflate Sep 09 16:25:18.920618 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: Connection: keep-alive Sep 09 16:25:18.920618 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: Content-Length: 0 Sep 09 16:25:18.920618 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: Host: 10.222.0.23 Sep 09 16:25:18.920618 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: Openstack-Api-Version: compute 2.92 Sep 09 16:25:18.920618 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: Openstack-System-Scope: None Sep 09 16:25:18.920618 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: User-Agent: python-novaclient Sep 09 16:25:18.920618 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: X-Auth-Token: gAAAAABjG2jucm0nvRjvg-vFrWpDzbce0Jwkzm-M0q2J7GiL8NfBEfRcGKqxs6vP6eLu6xxSuWt-aEnAvvAwIFFhW5CqqqZXGYrUQsG7eWsRqmaQH45HZjMCTUTiY5V_UrFxk8JKqxgf_sF-Dz_Vmo1WkjWXR7EatTkcSj0tYWRJIBezI0MACbQ Sep 09 16:25:18.920618 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: X-Domain-Id: None Sep 09 16:25:18.920618 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: X-Domain-Name: None Sep 09 16:25:18.920618 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: X-Identity-Status: Confirmed Sep 09 16:25:18.920618 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: X-Is-Admin-Project: True Sep 09 16:25:18.920618 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: X-Openstack-Nova-Api-Version: 2.92 Sep 09 16:25:18.920618 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: X-Project-Domain-Id: default Sep 09 16:25:18.920618 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: X-Project-Domain-Name: Default Sep 09 16:25:18.920618 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: X-Project-Id: f5e628b418b44cb0b8fcf5460ded8ac8 Sep 09 16:25:18.920618 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: X-Project-Name: admin Sep 09 16:25:18.920618 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: X-Role: admin,member,reader Sep 09 16:25:18.920618 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: X-Roles: admin,member,reader Sep 09 16:25:18.922107 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f5e628b418b44cb0b8fcf5460ded8ac8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f5e628b418b44cb0b8fcf5460ded8ac8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f5e628b418b44cb0b8fcf5460ded8ac8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f5e628b418b44cb0b8fcf5460ded8ac8"}]}] Sep 09 16:25:18.922107 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: X-Tenant: admin Sep 09 16:25:18.922107 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: X-Tenant-Id: f5e628b418b44cb0b8fcf5460ded8ac8 Sep 09 16:25:18.922107 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: X-Tenant-Name: admin Sep 09 16:25:18.922107 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: X-User: admin Sep 09 16:25:18.922107 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: X-User-Domain-Id: default Sep 09 16:25:18.922107 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: X-User-Domain-Name: Default Sep 09 16:25:18.922107 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: X-User-Id: 94cbbd1503324af1af6df581aea570b9 Sep 09 16:25:18.922107 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: X-User-Name: admin Sep 09 16:25:18.922107 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: method: > Sep 09 16:25:18.922107 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: exception: Flavor 451 could not be found. Sep 09 16:25:18.922107 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: action_args: {'id': '451'} Sep 09 16:25:18.922107 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: {{(pid=105533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 16:25:18.922107 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:25:18.923188 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 09 16:25:18.923188 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 09 16:25:18.923188 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 09 16:25:18.923188 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 09 16:25:18.923188 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 09 16:25:18.923188 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 09 16:25:18.923188 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 09 16:25:18.923188 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 09 16:25:18.923188 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 09 16:25:18.923188 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 16:25:18.923188 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 09 16:25:18.923188 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 09 16:25:18.923188 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 09 16:25:18.923188 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: ERROR nova.api.openstack.wsgi Sep 09 16:25:18.923188 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 16:25:18.923188 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: ERROR nova.api.openstack.wsgi Sep 09 16:25:18.923188 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:25:18.923188 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 16:25:18.923188 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 16:25:18.924495 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 16:25:18.924495 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 16:25:18.924495 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 16:25:18.924495 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 16:25:18.924495 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 09 16:25:18.924495 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 09 16:25:18.924495 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 09 16:25:18.924495 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: ERROR nova.api.openstack.wsgi Sep 09 16:25:18.924495 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 16:25:18.924495 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: ERROR nova.api.openstack.wsgi Sep 09 16:25:18.924495 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:25:18.924495 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 16:25:18.924495 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 16:25:18.924495 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 16:25:18.924495 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 16:25:18.924495 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 09 16:25:18.924495 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: ERROR nova.api.openstack.wsgi Sep 09 16:25:18.924495 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi [None req-581fd0fc-42f0-43a7-9f33-a9ec83d0cdbe admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105533) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 16:25:18.925548 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: INFO nova.api.openstack.requestlog [None req-581fd0fc-42f0-43a7-9f33-a9ec83d0cdbe admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.016837 Sep 09 16:25:18.925548 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: [pid: 105533|app: 0|req: 27/52] 10.222.0.23 () {60 vars in 1193 bytes} [Fri Sep 9 16:25:18 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 09 16:25:20.145587 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi [None req-ed913e82-6259-4fe1-b2f5-06119f535333 admin admin] Calling method '>' {{(pid=105534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:25:20.146618 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: INFO nova.api.openstack.requestlog [None req-ed913e82-6259-4fe1-b2f5-06119f535333 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Sep 09 16:25:20.147015 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: [pid: 105534|app: 0|req: 26/53] 10.222.0.23 () {56 vars in 1074 bytes} [Fri Sep 9 16:25:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:25:20.699585 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi [None req-9935041b-57dc-4e56-980a-eccbe23b8648 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:25:20.724391 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: INFO nova.api.openstack.requestlog [None req-9935041b-57dc-4e56-980a-eccbe23b8648 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.441453 Sep 09 16:25:20.724922 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: [pid: 105533|app: 0|req: 28/54] 10.222.0.23 () {64 vars in 1235 bytes} [Fri Sep 9 16:25:20 2022] POST /compute/v2.1/flavors => generated 404 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 16:25:21.940635 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi [None req-ed913e82-6259-4fe1-b2f5-06119f535333 admin admin] Calling method '>' {{(pid=105534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:25:21.941647 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: INFO nova.api.openstack.requestlog [None req-ed913e82-6259-4fe1-b2f5-06119f535333 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Sep 09 16:25:21.942018 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: [pid: 105534|app: 0|req: 27/55] 10.222.0.23 () {56 vars in 1074 bytes} [Fri Sep 9 16:25:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:25:22.490833 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi [None req-9b43aa7a-715c-49c1-add7-ecbce97556bd admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:25:22.513397 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: INFO nova.api.openstack.requestlog [None req-9b43aa7a-715c-49c1-add7-ecbce97556bd admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.437091 Sep 09 16:25:22.513943 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: [pid: 105533|app: 0|req: 29/56] 10.222.0.23 () {64 vars in 1235 bytes} [Fri Sep 9 16:25:22 2022] POST /compute/v2.1/flavors => generated 405 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 16:25:23.731710 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi [None req-ed913e82-6259-4fe1-b2f5-06119f535333 admin admin] Calling method '>' {{(pid=105534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:25:23.732714 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: INFO nova.api.openstack.requestlog [None req-ed913e82-6259-4fe1-b2f5-06119f535333 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Sep 09 16:25:23.733103 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: [pid: 105534|app: 0|req: 28/57] 10.222.0.23 () {56 vars in 1074 bytes} [Fri Sep 9 16:25:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:25:24.281966 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi [None req-33881fe2-abba-4c32-bec2-16fd8d7f8c4e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:25:24.303386 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: INFO nova.api.openstack.requestlog [None req-33881fe2-abba-4c32-bec2-16fd8d7f8c4e admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.436636 Sep 09 16:25:24.303928 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: [pid: 105533|app: 0|req: 30/58] 10.222.0.23 () {64 vars in 1235 bytes} [Fri Sep 9 16:25:23 2022] POST /compute/v2.1/flavors => generated 407 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 16:25:25.536082 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi [None req-ed913e82-6259-4fe1-b2f5-06119f535333 admin admin] Calling method '>' {{(pid=105534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:25:25.537106 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: INFO nova.api.openstack.requestlog [None req-ed913e82-6259-4fe1-b2f5-06119f535333 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Sep 09 16:25:25.537496 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: [pid: 105534|app: 0|req: 29/59] 10.222.0.23 () {56 vars in 1074 bytes} [Fri Sep 9 16:25:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:25:26.071761 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi [None req-e18727e9-200e-47e7-be5f-371f077ed12a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:25:26.097559 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: INFO nova.api.openstack.requestlog [None req-e18727e9-200e-47e7-be5f-371f077ed12a admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.425980 Sep 09 16:25:26.098115 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: [pid: 105533|app: 0|req: 31/60] 10.222.0.23 () {64 vars in 1235 bytes} [Fri Sep 9 16:25:25 2022] POST /compute/v2.1/flavors => generated 409 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 16:25:27.326024 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi [None req-ed913e82-6259-4fe1-b2f5-06119f535333 admin admin] Calling method '>' {{(pid=105534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:25:27.327425 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: INFO nova.api.openstack.requestlog [None req-ed913e82-6259-4fe1-b2f5-06119f535333 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002030 Sep 09 16:25:27.327933 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: [pid: 105534|app: 0|req: 30/61] 10.222.0.23 () {56 vars in 1074 bytes} [Fri Sep 9 16:25:27 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:25:27.868251 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi [None req-9a2f8c72-9333-40ba-bdd6-ffaa2cc22606 admin admin] Calling method '>' {{(pid=105533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:25:27.888638 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: INFO nova.api.openstack.requestlog [None req-9a2f8c72-9333-40ba-bdd6-ffaa2cc22606 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.422808 Sep 09 16:25:27.889171 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: [pid: 105533|app: 0|req: 32/62] 10.222.0.23 () {60 vars in 1202 bytes} [Fri Sep 9 16:25:27 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 16:26:24.770404 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi [None req-ed913e82-6259-4fe1-b2f5-06119f535333 admin admin] Calling method '>' {{(pid=105534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:26:24.771370 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: INFO nova.api.openstack.requestlog [None req-ed913e82-6259-4fe1-b2f5-06119f535333 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001541 Sep 09 16:26:24.771784 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: [pid: 105534|app: 0|req: 31/63] 10.222.0.23 () {54 vars in 931 bytes} [Fri Sep 9 16:26:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:26:24.786380 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG dbcounter [-] [105533] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=105533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:26:25.197779 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi [None req-08489bcc-6a88-41cf-9c7c-6a847fd3636d admin admin] Calling method '>' {{(pid=105533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:26:25.218183 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: INFO nova.api.openstack.requestlog [None req-08489bcc-6a88-41cf-9c7c-6a847fd3636d admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.438987 Sep 09 16:26:25.218788 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: [pid: 105533|app: 0|req: 33/64] 10.222.0.23 () {60 vars in 1292 bytes} [Fri Sep 9 16:26:24 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 16:26:25.240110 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG dbcounter [-] [105534] Writing DB stats nova_api:SELECT=14 {{(pid=105534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:26:25.244038 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi [None req-7c164a5b-1d5e-4cf7-9c42-a6ba737be5b3 admin admin] Calling method '>' {{(pid=105534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:26:25.251693 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: INFO nova.api.openstack.requestlog [None req-7c164a5b-1d5e-4cf7-9c42-a6ba737be5b3 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013180 Sep 09 16:26:25.252215 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: [pid: 105534|app: 0|req: 32/65] 10.222.0.23 () {60 vars in 1283 bytes} [Fri Sep 9 16:26:25 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:26:25.266259 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi [None req-f93c953c-b0d7-445b-b4ae-38a8b1b7c1ce admin admin] Calling method '>' {{(pid=105533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:26:25.278101 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: INFO nova.api.openstack.requestlog [None req-f93c953c-b0d7-445b-b4ae-38a8b1b7c1ce admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.017070 Sep 09 16:26:25.278940 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: [pid: 105533|app: 0|req: 34/66] 10.222.0.23 () {60 vars in 1286 bytes} [Fri Sep 9 16:26:25 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:26:25.290358 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi [None req-3e5e39d2-2dcf-4274-8508-679bb9a762c6 admin admin] Calling method '>' {{(pid=105534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:26:25.297402 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: INFO nova.api.openstack.requestlog [None req-3e5e39d2-2dcf-4274-8508-679bb9a762c6 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010592 Sep 09 16:26:25.297909 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: [pid: 105534|app: 0|req: 33/67] 10.222.0.23 () {60 vars in 1286 bytes} [Fri Sep 9 16:26:25 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:26:25.309546 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi [None req-fd3174f5-97e0-485d-996d-45513788b218 admin admin] Calling method '>' {{(pid=105533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:26:25.317089 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: INFO nova.api.openstack.requestlog [None req-fd3174f5-97e0-485d-996d-45513788b218 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010885 Sep 09 16:26:25.317593 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: [pid: 105533|app: 0|req: 35/68] 10.222.0.23 () {60 vars in 1283 bytes} [Fri Sep 9 16:26:25 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 16:29:45.018098 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi [None req-3e5e39d2-2dcf-4274-8508-679bb9a762c6 admin admin] Calling method '>' {{(pid=105534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:29:45.019170 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: INFO nova.api.openstack.requestlog [None req-3e5e39d2-2dcf-4274-8508-679bb9a762c6 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001520 Sep 09 16:29:45.019561 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: [pid: 105534|app: 0|req: 34/69] 10.222.0.23 () {56 vars in 1074 bytes} [Fri Sep 9 16:29:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:29:45.160980 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG dbcounter [-] [105533] Writing DB stats nova_api:SELECT=6 {{(pid=105533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:29:45.319565 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi [None req-87c20809-d130-4adc-a935-a2be0ab163c0 admin admin] Calling method '>' {{(pid=105533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:29:45.325747 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG oslo_concurrency.lockutils [None req-87c20809-d130-4adc-a935-a2be0ab163c0 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:29:45.326404 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG oslo_concurrency.lockutils [None req-87c20809-d130-4adc-a935-a2be0ab163c0 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:29:45.327027 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG oslo_concurrency.lockutils [None req-87c20809-d130-4adc-a935-a2be0ab163c0 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=105533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:29:45.328136 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG oslo_concurrency.lockutils [None req-87c20809-d130-4adc-a935-a2be0ab163c0 admin admin] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:29:45.328724 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG oslo_concurrency.lockutils [None req-87c20809-d130-4adc-a935-a2be0ab163c0 admin admin] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:29:45.329142 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG oslo_concurrency.lockutils [None req-87c20809-d130-4adc-a935-a2be0ab163c0 admin admin] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=105533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:29:45.359047 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: INFO nova.api.openstack.requestlog [None req-87c20809-d130-4adc-a935-a2be0ab163c0 admin admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.92 time: 0.200364 Sep 09 16:29:45.359644 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: [pid: 105533|app: 0|req: 36/70] 10.222.0.23 () {60 vars in 1193 bytes} [Fri Sep 9 16:29:45 2022] GET /compute/v2.1/os-services => generated 794 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 16:29:46.442776 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi [None req-3e5e39d2-2dcf-4274-8508-679bb9a762c6 admin admin] Calling method '>' {{(pid=105534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:29:46.443789 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: INFO nova.api.openstack.requestlog [None req-3e5e39d2-2dcf-4274-8508-679bb9a762c6 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Sep 09 16:29:46.444180 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: [pid: 105534|app: 0|req: 35/71] 10.222.0.23 () {56 vars in 1074 bytes} [Fri Sep 9 16:29:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:29:46.641560 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi [None req-6b056ec1-33b3-4e0a-8a95-3d444468568c admin admin] Calling method '>' {{(pid=105533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:29:46.645144 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG oslo_concurrency.lockutils [None req-6b056ec1-33b3-4e0a-8a95-3d444468568c admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:29:46.645541 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG oslo_concurrency.lockutils [None req-6b056ec1-33b3-4e0a-8a95-3d444468568c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:29:46.645997 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG oslo_concurrency.lockutils [None req-6b056ec1-33b3-4e0a-8a95-3d444468568c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:29:46.646730 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG oslo_concurrency.lockutils [None req-6b056ec1-33b3-4e0a-8a95-3d444468568c admin admin] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:29:46.647158 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG oslo_concurrency.lockutils [None req-6b056ec1-33b3-4e0a-8a95-3d444468568c admin admin] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:29:46.647586 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG oslo_concurrency.lockutils [None req-6b056ec1-33b3-4e0a-8a95-3d444468568c admin admin] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:29:46.668122 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: INFO nova.api.openstack.requestlog [None req-6b056ec1-33b3-4e0a-8a95-3d444468568c admin admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.92 time: 0.081097 Sep 09 16:29:46.668670 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: [pid: 105533|app: 0|req: 37/72] 10.222.0.23 () {60 vars in 1193 bytes} [Fri Sep 9 16:29:46 2022] GET /compute/v2.1/os-services => generated 794 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 16:29:58.183762 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi [None req-3e5e39d2-2dcf-4274-8508-679bb9a762c6 admin admin] Calling method '>' {{(pid=105534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:29:58.184773 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: INFO nova.api.openstack.requestlog [None req-3e5e39d2-2dcf-4274-8508-679bb9a762c6 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Sep 09 16:29:58.185314 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: [pid: 105534|app: 0|req: 36/73] 10.222.0.23 () {56 vars in 1074 bytes} [Fri Sep 9 16:29:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:29:58.327458 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG dbcounter [-] [105533] Writing DB stats nova_cell0:SELECT=4 {{(pid=105533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:29:58.328153 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG dbcounter [-] [105533] Writing DB stats nova_cell1:SELECT=4 {{(pid=105533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:29:58.328788 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG dbcounter [-] [105533] Writing DB stats nova_api:SELECT=8 {{(pid=105533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:29:58.385372 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi [None req-b2ca4f11-8b0a-45ab-9016-b550eaccd280 admin admin] Calling method '>' {{(pid=105533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:29:58.388799 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG oslo_concurrency.lockutils [None req-b2ca4f11-8b0a-45ab-9016-b550eaccd280 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:29:58.389267 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG oslo_concurrency.lockutils [None req-b2ca4f11-8b0a-45ab-9016-b550eaccd280 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:29:58.389686 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG oslo_concurrency.lockutils [None req-b2ca4f11-8b0a-45ab-9016-b550eaccd280 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:29:58.390383 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG oslo_concurrency.lockutils [None req-b2ca4f11-8b0a-45ab-9016-b550eaccd280 admin admin] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:29:58.390842 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG oslo_concurrency.lockutils [None req-b2ca4f11-8b0a-45ab-9016-b550eaccd280 admin admin] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:29:58.391252 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG oslo_concurrency.lockutils [None req-b2ca4f11-8b0a-45ab-9016-b550eaccd280 admin admin] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:29:58.415847 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: INFO nova.api.openstack.requestlog [None req-b2ca4f11-8b0a-45ab-9016-b550eaccd280 admin admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.92 time: 0.092831 Sep 09 16:29:58.416379 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: [pid: 105533|app: 0|req: 38/74] 10.222.0.23 () {60 vars in 1193 bytes} [Fri Sep 9 16:29:58 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 16:29:59.528810 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi [None req-3e5e39d2-2dcf-4274-8508-679bb9a762c6 admin admin] Calling method '>' {{(pid=105534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:29:59.529817 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: INFO nova.api.openstack.requestlog [None req-3e5e39d2-2dcf-4274-8508-679bb9a762c6 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Sep 09 16:29:59.530211 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: [pid: 105534|app: 0|req: 37/75] 10.222.0.23 () {56 vars in 1074 bytes} [Fri Sep 9 16:29:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:29:59.740016 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG nova.api.openstack.wsgi [None req-571526e8-482e-4564-a17f-b859240b9833 admin admin] Calling method '>' {{(pid=105533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:29:59.743363 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG oslo_concurrency.lockutils [None req-571526e8-482e-4564-a17f-b859240b9833 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:29:59.743837 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG oslo_concurrency.lockutils [None req-571526e8-482e-4564-a17f-b859240b9833 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:29:59.744270 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG oslo_concurrency.lockutils [None req-571526e8-482e-4564-a17f-b859240b9833 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:29:59.744980 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG oslo_concurrency.lockutils [None req-571526e8-482e-4564-a17f-b859240b9833 admin admin] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:29:59.745423 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG oslo_concurrency.lockutils [None req-571526e8-482e-4564-a17f-b859240b9833 admin admin] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:29:59.745836 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: DEBUG oslo_concurrency.lockutils [None req-571526e8-482e-4564-a17f-b859240b9833 admin admin] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:29:59.767177 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: INFO nova.api.openstack.requestlog [None req-571526e8-482e-4564-a17f-b859240b9833 admin admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.92 time: 0.092706 Sep 09 16:29:59.767711 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: [pid: 105533|app: 0|req: 39/76] 10.222.0.23 () {60 vars in 1193 bytes} [Fri Sep 9 16:29:59 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 16:30:55.653352 dv-cinder-831247-27-iscsi devstack@n-api.service[105532]: Fri Sep 9 16:30:55 2022 - graceful shutdown triggered... Sep 09 16:30:55.653875 dv-cinder-831247-27-iscsi devstack@n-api.service[105533]: Gracefully killing worker 1 (pid: 105533)... Sep 09 16:30:55.653436 dv-cinder-831247-27-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 09 16:30:55.655648 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: Gracefully killing worker 2 (pid: 105534)... Sep 09 16:30:55.785945 dv-cinder-831247-27-iscsi devstack@n-api.service[105534]: DEBUG dbcounter [-] [105534] Writing DB stats nova_api:SELECT=4 {{(pid=105534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:30:56.655591 dv-cinder-831247-27-iscsi devstack@n-api.service[105532]: worker 1 buried after 1 seconds Sep 09 16:30:56.656542 dv-cinder-831247-27-iscsi devstack@n-api.service[105532]: worker 2 buried after 1 seconds Sep 09 16:30:56.656542 dv-cinder-831247-27-iscsi devstack@n-api.service[105532]: goodbye to uWSGI. Sep 09 16:30:56.658210 dv-cinder-831247-27-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 09 16:30:56.659158 dv-cinder-831247-27-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 09 16:30:56.664529 dv-cinder-831247-27-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 09 16:30:56.677602 dv-cinder-831247-27-iscsi devstack@n-api.service[127178]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 09 16:30:56.679921 dv-cinder-831247-27-iscsi devstack@n-api.service[127178]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Sep 9 16:30:56 2022] *** Sep 09 16:30:56.679921 dv-cinder-831247-27-iscsi devstack@n-api.service[127178]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 09 16:30:56.679921 dv-cinder-831247-27-iscsi devstack@n-api.service[127178]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 09 16:30:56.679921 dv-cinder-831247-27-iscsi devstack@n-api.service[127178]: nodename: dv-cinder-831247-27-iscsi Sep 09 16:30:56.679921 dv-cinder-831247-27-iscsi devstack@n-api.service[127178]: machine: x86_64 Sep 09 16:30:56.679921 dv-cinder-831247-27-iscsi devstack@n-api.service[127178]: clock source: unix Sep 09 16:30:56.679921 dv-cinder-831247-27-iscsi devstack@n-api.service[127178]: pcre jit disabled Sep 09 16:30:56.679921 dv-cinder-831247-27-iscsi devstack@n-api.service[127178]: detected number of CPU cores: 4 Sep 09 16:30:56.679921 dv-cinder-831247-27-iscsi devstack@n-api.service[127178]: current working directory: / Sep 09 16:30:56.679921 dv-cinder-831247-27-iscsi devstack@n-api.service[127178]: detected binary path: /usr/bin/uwsgi-core Sep 09 16:30:56.680704 dv-cinder-831247-27-iscsi devstack@n-api.service[127178]: your processes number limit is 47680 Sep 09 16:30:56.680704 dv-cinder-831247-27-iscsi devstack@n-api.service[127178]: your memory page size is 4096 bytes Sep 09 16:30:56.680704 dv-cinder-831247-27-iscsi devstack@n-api.service[127178]: detected max file descriptor number: 2048 Sep 09 16:30:56.680704 dv-cinder-831247-27-iscsi devstack@n-api.service[127178]: lock engine: pthread robust mutexes Sep 09 16:30:56.680988 dv-cinder-831247-27-iscsi devstack@n-api.service[127178]: thunder lock: enabled Sep 09 16:30:56.681055 dv-cinder-831247-27-iscsi devstack@n-api.service[127178]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 09 16:30:56.681121 dv-cinder-831247-27-iscsi devstack@n-api.service[127178]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 09 16:30:56.720931 dv-cinder-831247-27-iscsi devstack@n-api.service[127178]: Python main interpreter initialized at 0x5596d60259c0 Sep 09 16:30:56.720931 dv-cinder-831247-27-iscsi devstack@n-api.service[127178]: python threads support enabled Sep 09 16:30:56.720931 dv-cinder-831247-27-iscsi devstack@n-api.service[127178]: your server socket listen backlog is limited to 100 connections Sep 09 16:30:56.720931 dv-cinder-831247-27-iscsi devstack@n-api.service[127178]: your mercy for graceful operations on workers is 90 seconds Sep 09 16:30:56.721426 dv-cinder-831247-27-iscsi devstack@n-api.service[127178]: mapped 403077 bytes (393 KB) for 2 cores Sep 09 16:30:56.721426 dv-cinder-831247-27-iscsi devstack@n-api.service[127178]: *** Operational MODE: preforking *** Sep 09 16:30:56.721673 dv-cinder-831247-27-iscsi devstack@n-api.service[127178]: *** uWSGI is running in multiple interpreter mode *** Sep 09 16:30:56.721673 dv-cinder-831247-27-iscsi devstack@n-api.service[127178]: spawned uWSGI master process (pid: 127178) Sep 09 16:30:56.721936 dv-cinder-831247-27-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 09 16:30:56.723128 dv-cinder-831247-27-iscsi devstack@n-api.service[127178]: spawned uWSGI worker 1 (pid: 127196, cores: 1) Sep 09 16:30:56.724089 dv-cinder-831247-27-iscsi devstack@n-api.service[127178]: spawned uWSGI worker 2 (pid: 127198, cores: 1) Sep 09 16:30:56.724392 dv-cinder-831247-27-iscsi devstack@n-api.service[127178]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 09 16:30:57.376418 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 09 16:30:57.377065 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 09 16:30:58.511979 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 16:30:58.511979 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: from cryptography.utils import int_from_bytes Sep 09 16:30:58.512717 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 16:30:58.512717 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: from cryptography.utils import int_from_bytes Sep 09 16:30:58.523681 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 16:30:58.523681 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: from cryptography.utils import int_from_bytes Sep 09 16:30:58.524237 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 16:30:58.524237 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: from cryptography.utils import int_from_bytes Sep 09 16:31:00.913472 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 09 16:31:00.914360 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 09 16:31:00.915087 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 09 16:31:00.915651 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 09 16:31:00.916082 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 09 16:31:00.916641 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.917251 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.917772 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.918097 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.918560 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.918821 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.919484 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.919626 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.919844 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.920108 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.920426 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.920925 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-831247-27-iscsi {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.921270 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.921708 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.921893 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.922239 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.922568 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.922897 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.923331 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.923869 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.925378 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.925378 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.925378 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.925378 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.925703 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.926171 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.926428 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.926763 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.927082 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.927401 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.927809 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-831247-27-iscsi {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.928116 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.928440 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.928747 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.929168 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.929488 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.929798 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.930272 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.930437 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.930917 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.931419 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.931899 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.932367 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.932832 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.933281 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.933754 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.934262 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.934572 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.935032 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.935344 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.935585 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.936296 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.936456 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.936943 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.937541 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.937960 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.938242 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.938620 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.938955 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.939272 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.939579 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.939886 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.940193 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.940498 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.940803 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.941109 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.941445 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.941766 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.942081 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.942407 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.942713 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.943040 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.943467 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.23 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.943684 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.23 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.944151 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.944681 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.945004 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.945310 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.945538 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 09 16:31:00.945989 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.946069 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 09 16:31:00.946158 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.946239 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.946443 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 09 16:31:00.946654 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.946749 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 09 16:31:00.946825 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.946987 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 09 16:31:00.947090 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.947375 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.947478 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.947728 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.947879 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.948008 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.948094 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.948294 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.948399 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.948561 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.948720 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.948877 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.949033 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.949189 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.949360 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.949516 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.949677 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.949850 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.949996 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.950148 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.950292 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.950459 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.950699 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.950854 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.951018 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.951194 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-831247-27-iscsi {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.951343 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.951494 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.951661 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.951806 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.951956 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.952107 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.954879 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.955051 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.955225 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.955383 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.955545 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.955696 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.955936 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.956094 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.956268 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.956268 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.956551 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.956723 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.956951 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.957121 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.957267 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.957429 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.957593 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.957738 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.957888 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.959066 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.959228 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.959390 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.959545 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.959704 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.959849 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.960007 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.960151 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.960304 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.960448 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.960600 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.960929 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.961084 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.961630 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-831247-27-iscsi {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.961788 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.961944 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.962098 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.962244 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.962388 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.962593 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.962745 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.962745 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.963035 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.963182 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.963340 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.963495 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.963640 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.963790 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.963940 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.964125 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.964289 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.964434 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.964637 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.964793 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.964946 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.965098 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.965258 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.965403 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.965562 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.965710 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.965862 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.966006 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.966159 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.966305 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.966459 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.966651 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.966808 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.966961 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.967106 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.967263 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.967408 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.967551 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.967694 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.967851 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.967996 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.968155 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:00.969085 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.969263 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:00.969419 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.969601 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:00.969841 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.970030 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:00.970190 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.970339 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:00.970513 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.970666 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:00.970821 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.970975 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:00.971120 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.971275 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:00.971429 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.971684 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:00.971854 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.972083 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:00.972241 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.972396 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:00.972551 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.972551 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.972843 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:00.973004 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.973004 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.973310 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:00.973463 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.973619 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:00.973764 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.973908 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:00.974059 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.974225 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:00.974392 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.974641 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:00.974833 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.974997 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:00.975158 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.975158 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.975471 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:00.975471 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:00.975765 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.23 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.975765 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.23 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.976046 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:00.976207 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.976359 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:00.976504 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.976649 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:00.976803 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.977021 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:00.977172 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.977317 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:00.977472 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.977623 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:00.977776 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.977961 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:00.978117 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.978261 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:00.978680 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.978846 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:00.979300 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.979465 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:00.979612 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.979767 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:00.979932 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.980084 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:00.980247 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.980247 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.980537 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:00.980690 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.980843 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:00.981029 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.981193 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:00.981346 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.981497 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:00.981744 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.981906 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:00.982173 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.982344 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:00.982525 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.982677 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:00.982832 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.982985 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:00.983137 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.983291 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:00.983435 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.983579 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:00.983723 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.983865 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:00.984010 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.984010 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.984377 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:00.984530 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.984682 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:00.984865 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.985029 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:00.985182 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.985337 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:00.985489 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.985655 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:00.985810 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.985964 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:00.986117 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.986273 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:00.986416 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.986579 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:00.986744 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.986904 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:00.987056 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.987210 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:00.987371 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.987522 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:00.987666 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.987809 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:00.987968 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.988130 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:00.988287 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.988441 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:00.988802 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.988955 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:00.989381 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.989381 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.989662 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:00.989816 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.989968 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:00.990112 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.990255 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:00.990567 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.990736 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:00.990898 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.991051 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:00.991196 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.991341 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:00.991490 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.991636 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:00.991898 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.992053 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:00.992299 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.992454 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:00.992599 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.992758 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:00.992925 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.993079 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:00.993224 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.993368 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:00.993524 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.993683 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:00.993834 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.993980 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:00.994123 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.994274 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:00.994420 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.994606 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:00.994761 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.994965 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:00.995114 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.995259 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:00.995419 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.995576 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:00.995730 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.995882 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:00.996027 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.996178 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:00.996337 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.996483 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:00.996636 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.996790 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:00.996954 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:31:00.997107 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:00.997262 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:00.997407 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:00.997549 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:00.997702 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:00.997846 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:00.997999 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:00.998161 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:00.998307 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:00.998451 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:00.998630 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:00.999015 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:00.999452 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:00.999607 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:00.999785 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:00.999941 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:00.999941 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:00.999941 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.000368 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.000514 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.000674 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.000826 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.000971 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.001115 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.001280 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.001425 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.001576 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.001729 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.001875 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.002129 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.002296 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.002605 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.002769 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.002927 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.003073 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.003230 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.003394 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.003546 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.003698 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.003850 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.004003 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.004163 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.004317 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.004469 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.004613 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.004763 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.004915 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.005118 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.005274 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.005437 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.005589 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.005746 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.005898 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.006058 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.006204 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.006347 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.006514 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.006678 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.006839 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.006992 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.007145 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.007289 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.007444 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.007587 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.007822 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.007976 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.008130 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.008292 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.008449 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.008593 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.008769 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.009101 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.009389 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.009685 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.009830 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.009986 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.010141 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.010286 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.010430 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.010606 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.010752 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.010978 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.011150 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.011297 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.011449 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.011594 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.011747 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.011901 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.012056 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.012307 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.012471 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.012714 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.012874 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.013029 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.013182 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.013326 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.013470 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.013613 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.013765 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.013919 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.014075 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.014219 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.014362 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.014525 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.014688 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.014843 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.014988 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.015171 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.015391 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.015840 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.016004 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.016160 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.016921 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.017330 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.017485 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.017631 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.017927 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.018342 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.018563 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.018730 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.018884 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.019286 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.019778 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.019941 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.020116 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.020261 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.020405 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.020548 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.020692 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.020834 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.020998 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.021150 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.021294 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.021437 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.021580 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.021731 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.021886 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.022043 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.022195 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.022340 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.022483 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.022667 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.022944 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.023104 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.023277 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.023522 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.023672 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.023826 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.023972 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.024115 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.024270 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.024414 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.024558 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.024711 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.024862 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.025015 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.025207 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.025356 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.025518 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.025674 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.025819 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.025963 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.026127 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.026271 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.026414 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.026589 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.026739 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.026890 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.027034 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.027192 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.027350 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.027494 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.027644 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.027794 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.027946 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.028266 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.028452 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.028607 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.028758 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.028908 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.029856 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.030024 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.030190 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.031219 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.031403 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.031572 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.031738 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.031891 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.032071 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.032233 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.032403 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.032556 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.032706 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.032877 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.033147 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.033316 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.033469 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.033736 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.033897 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.034059 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.034219 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.034385 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.034568 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.034726 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.034726 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.035028 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.035188 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.035381 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.035381 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.035696 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.035696 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.036000 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.036000 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.036303 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.036466 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.036617 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.036782 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.036933 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.037083 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.037241 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.037392 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.037551 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.037717 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.037876 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.038036 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.038187 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.038356 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.038547 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.038547 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.038867 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.039029 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.039180 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.039352 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.039861 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.040170 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.040323 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.040474 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.040624 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.040776 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.040776 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.041098 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.041256 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.041408 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.041574 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.041744 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.041905 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.042065 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.042226 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.042377 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.042600 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.042770 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.042928 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.043090 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.043360 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.043528 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.043690 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.043953 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.044158 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.044314 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.044465 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.044626 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.044786 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.044947 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.045106 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.045267 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.045479 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.045650 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.045802 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.045964 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.046124 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.046276 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.046426 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.046774 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.046932 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.047091 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.047243 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.047409 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.047572 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.047745 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.047905 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.048066 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.048226 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.048387 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.048553 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.048713 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.048890 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.050615 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.051608 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.051756 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.051833 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.051903 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.051972 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.052040 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.052139 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.052224 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.052296 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.052373 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.052445 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.052520 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.052598 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.052677 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.052755 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.052825 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.052901 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.052977 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.053056 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.053127 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.053197 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.053265 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.053344 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.053422 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.053505 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.053583 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.053660 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.053731 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.053905 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.053987 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.054065 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.054136 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.054207 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.054276 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.054356 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.054534 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.054624 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.054703 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.054781 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.054941 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.055020 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.055096 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.055172 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.055242 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.055323 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.055394 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.055464 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.055547 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.055619 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.055689 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.055766 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.055837 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.055915 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.055986 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.056055 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.056133 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.056204 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.056286 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.056365 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.056436 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.056506 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.056583 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.056654 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.056731 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.056800 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.056869 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.056944 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.057027 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.057105 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.057176 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.057176 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.057316 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.057393 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.057471 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.057548 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.057619 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.057694 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.057769 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.057851 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.057922 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.057991 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.058067 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.058136 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.058205 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.058287 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.058372 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.058443 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.058537 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.058611 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.058692 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.058772 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.060247 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.060352 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.060429 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.060499 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.060576 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.060657 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.060736 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.060807 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.060874 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.060942 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.061020 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.061091 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.061160 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.061228 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.061296 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.061371 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.061455 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.061525 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.061525 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.061656 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.061733 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.061809 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.061892 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.061962 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.062037 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.062114 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.062212 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.062298 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.062383 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.062462 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.062568 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.062660 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.062733 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.062733 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.062880 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.062957 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.063026 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.063026 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.063160 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.063160 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.063284 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.063352 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.063352 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.063352 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.063547 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.063617 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.063686 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.063761 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.063844 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.063915 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.063984 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.064052 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.064128 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.064197 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.064305 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.064383 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.064453 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.064522 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.064597 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.064674 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.064763 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.064833 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.064901 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.064975 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.065044 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.065111 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.065193 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.065269 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.065403 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.065520 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.065630 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.065738 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.065860 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.065975 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.066066 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.066150 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.066233 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.066324 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.066411 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.066490 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.066595 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.066667 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.066788 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.066913 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.067028 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.067162 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.067250 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.067250 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.067250 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.067493 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.067577 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.067666 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.067785 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.067876 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.067970 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.068053 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.068141 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.068231 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.068314 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.068404 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.068562 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.068656 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.068739 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.068829 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.068906 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.069033 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.069136 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.069228 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.069318 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.069318 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.069471 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.069552 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.069647 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.069730 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.069857 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.069975 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.070090 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.070194 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.070286 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.070369 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.070455 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.070564 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.070696 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.070820 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.070936 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.071052 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.071159 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.071248 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.071333 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.071426 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.071510 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.071593 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.071682 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.071764 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.071847 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.071937 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.071937 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.072088 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.072178 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.072269 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.072360 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.072451 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.072541 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.072624 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.072705 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.072786 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.072941 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.072941 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.073173 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.073292 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.073403 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.073516 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.073717 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.073882 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.074084 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.074248 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.074403 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.074651 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.074818 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.074974 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.075123 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.075282 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.075430 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.075586 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.075734 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.075888 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.076036 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.076182 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.076330 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.076492 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.076639 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.076785 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.076939 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.077087 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.077252 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.077414 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.077562 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.077717 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.077981 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.078136 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.078284 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.078446 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.078615 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.078773 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.078930 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.079086 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.079260 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.079429 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.079589 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.079589 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.079879 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.080035 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.080193 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.080348 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.080504 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.080659 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.080814 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.080961 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.081122 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.081280 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.081435 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.081591 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.081738 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.081885 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.082047 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.082195 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.082342 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.082535 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.082701 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.082858 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.083005 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.083152 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.083316 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.083464 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.083619 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.083777 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.083924 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.084071 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.084226 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.084896 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.085005 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.085090 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.085172 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.085254 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.085335 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.085416 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.085507 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.085598 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.085687 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.085775 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.085857 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.085952 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.086164 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.086256 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.086510 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.086604 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.086855 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.086981 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.087161 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.087253 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.087474 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.087566 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.087800 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.087901 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.088104 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.088203 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.088424 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.088521 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.088732 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.088831 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.089041 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.089129 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.089355 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.089452 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.089667 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.089766 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.089973 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.090060 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.090281 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.090378 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.090620 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.090713 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.090931 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.091032 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.091243 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.091339 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.091557 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.091648 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.091872 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.091961 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.092186 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.092289 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.092492 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.092579 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.092818 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.092912 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.093130 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.093229 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.093454 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.093554 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.093770 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.093859 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.094078 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.094179 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.094394 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.094547 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.094737 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.094870 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.095071 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.095173 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.095410 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.095511 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.095745 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.095845 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.096059 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.096156 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.096390 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.096486 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.096708 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.096870 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.097029 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.097121 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.097347 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.097437 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.097654 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.097751 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.097988 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.098110 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.098298 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.098389 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.098632 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.098746 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.098945 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.099035 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.099253 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.099351 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.099564 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.099655 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.099872 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.099972 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.100182 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.100285 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.100487 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.100578 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.100794 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.100882 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.101098 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.101186 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.101426 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.101517 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.101734 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.101829 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.102056 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.102153 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.102367 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.102466 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.102716 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.102812 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.103025 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.103133 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.103334 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.103525 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.103683 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.103844 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.103992 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.104162 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.104324 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.104492 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.104626 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.104822 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.104950 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.105154 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.105260 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.105466 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.105563 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.105787 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.105876 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.106105 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.106195 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.106436 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.106579 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.106797 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.106898 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.107117 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.107206 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.107425 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.107521 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.107734 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.107838 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.108054 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.108149 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.108373 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.108462 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.108691 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.108942 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.109040 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.109328 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.109490 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.109645 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.109826 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.109976 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.110188 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.110293 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.110562 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.110655 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.110908 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.111008 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.111222 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.111312 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.111533 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.111630 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.111848 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.111938 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.112164 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.112256 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.112475 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.112572 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.112804 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.112894 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.113119 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.113210 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.113438 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.113539 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.113756 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.113847 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.114072 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.114173 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.114383 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.114488 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.114728 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.114871 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.115059 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.115191 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.115367 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.115470 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.115693 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.115783 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.116011 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.116101 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.116328 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.116418 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.116647 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.116746 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.116956 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.117045 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.117268 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.117358 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.117585 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.117674 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.117896 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.117993 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.118208 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.118307 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.118539 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.118644 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.118854 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.118957 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.119170 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.119260 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.119493 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.119583 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.119828 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.119927 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.120152 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.120251 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.120463 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.120552 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.120779 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.120886 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.121096 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.121186 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.121431 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.121618 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.121750 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.121941 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.122076 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.122283 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.122373 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.122642 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.122747 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.122976 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.123066 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.123298 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.123389 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.123617 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.123782 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.123930 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.124020 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.124238 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.124328 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.124546 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.124649 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.124880 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.125015 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.125188 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.125311 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.125495 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.125607 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.125821 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.125910 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.126133 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.126230 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.126443 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.126572 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.126789 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.126880 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.127099 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.127196 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.127412 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.127632 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.127731 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.127992 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.128117 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.128309 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.128411 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.128638 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.128737 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.128966 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.129056 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.129284 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.129388 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.129596 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.129686 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.129915 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.130004 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.130222 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.130311 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.130567 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.130690 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.130887 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.130982 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.131203 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.131293 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.131510 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.131607 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.131818 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.131909 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.132130 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.132230 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.132441 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.132530 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.132749 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.132847 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.133060 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.133314 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.133404 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.133649 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.133739 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.133970 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.134060 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.134276 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.134365 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.134605 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.134697 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.134921 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.135022 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.135229 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.135326 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.135535 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.135623 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.135842 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.135933 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.136148 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.136240 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.136460 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.136559 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.136763 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.136861 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.137105 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.137202 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.137436 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.137539 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.137772 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.137860 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.138099 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.138189 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.138422 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.138538 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.138755 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.138853 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.139085 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.139185 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.139393 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.139484 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.139698 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.139787 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.140021 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.140112 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.140352 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.140469 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.140711 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.140811 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.141027 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.141117 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.141344 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.141440 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.141661 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.141750 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.141981 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.142084 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.142300 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.142545 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.142641 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.142883 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.142973 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.143211 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.143302 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.143549 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.143640 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.143883 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.143971 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.144193 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.144289 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.144506 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.144595 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.144816 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.144905 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.145142 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.145263 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.145456 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.145545 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.145773 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.146017 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.146108 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.146339 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.146427 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.146711 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.146814 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.147030 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.147119 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.147343 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.147440 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.147661 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.147761 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.147974 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.148073 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.148285 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.148383 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.148599 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.148700 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.148906 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.149004 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.149216 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.149312 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.149527 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.149632 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.149838 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.149934 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.150163 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.150260 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.150479 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.150615 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.150812 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.150910 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.151130 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.151227 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.151441 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.151544 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.151752 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.151979 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.152076 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.152335 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.152435 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.152654 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.152747 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.152969 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.153056 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.153305 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.153473 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.153624 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.153722 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.153932 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.154029 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.154259 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.154357 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.154597 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.154703 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.154915 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.155005 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.155239 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.155436 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.155558 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.155692 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.156015 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.156168 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.156257 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.156329 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.156552 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.156674 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.156869 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.156959 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.157195 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.157285 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.157529 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.157675 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.157842 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.157967 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.158191 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.158282 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.158539 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.158667 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.158852 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.158954 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.159159 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.159257 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.159465 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.159560 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.159822 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.159935 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.160082 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.160181 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.160389 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.160479 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.160694 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.160796 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.161001 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.161092 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.161304 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.161403 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.161611 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.161707 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.161919 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.162017 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.162227 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.162318 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.162681 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.162787 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.163000 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.163088 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.163309 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.163400 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.163615 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.163704 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.163921 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.164019 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.164226 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.164323 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.164530 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.164628 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.164841 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.164938 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.165152 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.165291 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.165461 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.165598 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.165770 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.165869 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.166078 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.166167 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.166385 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.166475 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.166718 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.166979 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.167079 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.167324 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.167415 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.167650 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.167790 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.167986 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.168075 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.168301 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.168393 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.168620 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.168708 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.168933 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.169031 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.169242 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.169332 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.169570 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.169660 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.169884 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.169983 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.170202 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.170300 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.170536 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.170641 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.170858 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.170965 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.171173 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.171263 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.171488 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.171602 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.171856 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.171957 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.172167 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.172257 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.172480 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.172565 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.172796 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.172883 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.173118 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.173215 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.173424 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.173512 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.173740 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.173831 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.174057 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.174154 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.174377 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.174473 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.174751 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.174853 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.175081 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.175170 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.175404 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.175501 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.175715 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.176162 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.176393 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.176491 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.176706 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.176804 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.177019 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.177121 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.177334 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.177429 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.177649 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.177748 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.177961 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.178052 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.178279 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.178368 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.178626 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.178731 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.178940 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.179038 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.179271 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.179367 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.179602 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.179701 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.179916 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.180007 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.180243 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.180339 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.180574 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.180665 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.180899 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.180987 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.181224 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.181327 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.181539 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.181630 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.181865 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.181953 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.182180 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.182270 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.182524 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.182616 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.182832 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.182934 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.183079 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 09 16:31:01.183258 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.183513 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.183824 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.184135 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.184444 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.184756 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.185080 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.185397 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.185707 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.186014 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.186329 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.186668 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.187027 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.187313 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.187625 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.187935 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.188242 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.188552 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.188861 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.189169 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.189478 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.189786 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.190102 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.190414 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.190749 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.191059 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.191369 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.191677 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.192015 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.192372 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.192670 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.193006 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.193321 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.193648 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.193966 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.194292 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.194643 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.194968 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.195281 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.195618 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.195939 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.196246 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.196562 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.196878 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.197191 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.197500 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.197836 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.198167 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.198477 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.198830 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.199150 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.199475 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.199792 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.200109 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.200448 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.200753 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.201068 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.201380 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.201693 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.202008 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.202327 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.202664 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.203078 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.203404 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.203723 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.204055 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.204385 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.204700 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.205030 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.205681 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.205681 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.206240 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.206355 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.206698 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.207017 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.207334 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.207643 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:31:01.207891 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 09 16:31:01.244096 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO dbcounter [None req-b18072c8-b653-43e9-8fa3-98494100a297 None None] Registered counter for database nova_api Sep 09 16:31:01.265596 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_db.sqlalchemy.engines [None req-b18072c8-b653-43e9-8fa3-98494100a297 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127196) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 16:31:01.269083 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO dbcounter [None req-771b709e-a2a7-4c08-bd4c-4fb5f9b63440 None None] Registered counter for database nova_api Sep 09 16:31:01.273376 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG dbcounter [-] [127196] Writer thread running {{(pid=127196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 16:31:01.289484 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_db.sqlalchemy.engines [None req-771b709e-a2a7-4c08-bd4c-4fb5f9b63440 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127198) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 16:31:01.296766 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writer thread running {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 16:31:01.329551 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.context [None req-b18072c8-b653-43e9-8fa3-98494100a297 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),48ce3bd6-80cf-484b-9bda-21ff297cb34a(cell1) {{(pid=127196) load_cells /opt/stack/nova/nova/context.py:464}} Sep 09 16:31:01.333628 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-b18072c8-b653-43e9-8fa3-98494100a297 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:31:01.334111 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-b18072c8-b653-43e9-8fa3-98494100a297 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:31:01.335740 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-b18072c8-b653-43e9-8fa3-98494100a297 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:31:01.336481 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-b18072c8-b653-43e9-8fa3-98494100a297 None None] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:31:01.336930 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-b18072c8-b653-43e9-8fa3-98494100a297 None None] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:31:01.338969 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-b18072c8-b653-43e9-8fa3-98494100a297 None None] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:31:01.340960 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO dbcounter [None req-b18072c8-b653-43e9-8fa3-98494100a297 None None] Registered counter for database nova_cell0 Sep 09 16:31:01.345088 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO dbcounter [None req-b18072c8-b653-43e9-8fa3-98494100a297 None None] Registered counter for database nova_cell1 Sep 09 16:31:01.352497 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_db.sqlalchemy.engines [None req-b18072c8-b653-43e9-8fa3-98494100a297 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127196) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 16:31:01.353413 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.context [None req-771b709e-a2a7-4c08-bd4c-4fb5f9b63440 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),48ce3bd6-80cf-484b-9bda-21ff297cb34a(cell1) {{(pid=127198) load_cells /opt/stack/nova/nova/context.py:464}} Sep 09 16:31:01.355486 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_db.sqlalchemy.engines [None req-b18072c8-b653-43e9-8fa3-98494100a297 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127196) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 16:31:01.359495 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-771b709e-a2a7-4c08-bd4c-4fb5f9b63440 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:31:01.359971 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-771b709e-a2a7-4c08-bd4c-4fb5f9b63440 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:31:01.361575 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-771b709e-a2a7-4c08-bd4c-4fb5f9b63440 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:31:01.362329 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-771b709e-a2a7-4c08-bd4c-4fb5f9b63440 None None] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:31:01.362602 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG dbcounter [-] [127196] Writer thread running {{(pid=127196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 16:31:01.362803 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-771b709e-a2a7-4c08-bd4c-4fb5f9b63440 None None] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:31:01.363878 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG dbcounter [-] [127196] Writer thread running {{(pid=127196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 16:31:01.364838 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-771b709e-a2a7-4c08-bd4c-4fb5f9b63440 None None] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:31:01.366938 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO dbcounter [None req-771b709e-a2a7-4c08-bd4c-4fb5f9b63440 None None] Registered counter for database nova_cell0 Sep 09 16:31:01.371145 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO dbcounter [None req-771b709e-a2a7-4c08-bd4c-4fb5f9b63440 None None] Registered counter for database nova_cell1 Sep 09 16:31:01.378635 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_db.sqlalchemy.engines [None req-771b709e-a2a7-4c08-bd4c-4fb5f9b63440 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127198) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 16:31:01.380960 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_db.sqlalchemy.engines [None req-771b709e-a2a7-4c08-bd4c-4fb5f9b63440 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127198) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 16:31:01.385672 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writer thread running {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 16:31:01.508528 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO dbcounter [None req-b18072c8-b653-43e9-8fa3-98494100a297 None None] Registered counter for database nova_cell0 Sep 09 16:31:01.515504 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_db.sqlalchemy.engines [None req-b18072c8-b653-43e9-8fa3-98494100a297 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127196) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 16:31:01.520442 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG dbcounter [-] [127196] Writer thread running {{(pid=127196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 16:31:01.526914 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writer thread running {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 16:31:01.537186 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO dbcounter [None req-771b709e-a2a7-4c08-bd4c-4fb5f9b63440 None None] Registered counter for database nova_cell0 Sep 09 16:31:01.546805 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_db.sqlalchemy.engines [None req-771b709e-a2a7-4c08-bd4c-4fb5f9b63440 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127198) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 16:31:01.553347 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writer thread running {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 16:31:01.833075 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: WARNING keystonemiddleware.auth_token [None req-b18072c8-b653-43e9-8fa3-98494100a297 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 09 16:31:01.840101 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: WARNING keystonemiddleware.auth_token [None req-b18072c8-b653-43e9-8fa3-98494100a297 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 09 16:31:01.875922 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: WARNING keystonemiddleware.auth_token [None req-771b709e-a2a7-4c08-bd4c-4fb5f9b63440 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 09 16:31:01.883214 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: WARNING keystonemiddleware.auth_token [None req-771b709e-a2a7-4c08-bd4c-4fb5f9b63440 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 09 16:31:02.189487 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: WARNING keystonemiddleware.auth_token [None req-b18072c8-b653-43e9-8fa3-98494100a297 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 09 16:31:02.195588 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: WARNING keystonemiddleware.auth_token [None req-b18072c8-b653-43e9-8fa3-98494100a297 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 09 16:31:02.200944 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5596d60259c0 pid: 127196 (default app) Sep 09 16:31:02.231723 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: WARNING keystonemiddleware.auth_token [None req-771b709e-a2a7-4c08-bd4c-4fb5f9b63440 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 09 16:31:02.237817 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: WARNING keystonemiddleware.auth_token [None req-771b709e-a2a7-4c08-bd4c-4fb5f9b63440 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 09 16:31:02.243178 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5596d60259c0 pid: 127198 (default app) Sep 09 16:31:38.381047 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG dbcounter [-] [127196] Writing DB stats nova_api:SELECT=3 {{(pid=127196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:31:38.383657 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG dbcounter [-] [127196] Writing DB stats nova_cell1:SELECT=3 {{(pid=127196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:31:38.384984 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG dbcounter [-] [127196] Writing DB stats nova_cell0:SELECT=3 {{(pid=127196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:31:38.387538 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG dbcounter [-] [127196] Writing DB stats nova_cell0:SELECT=3 {{(pid=127196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:31:39.609472 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-7a8d3a53-6743-45d0-901c-87930414be75 tempest-VolumesNegativeTest-408784968 tempest-VolumesNegativeTest-408784968-project] Action: 'create', calling method: .version_select at 0x7f24fc6053a0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-917138627", "metadata": {"Type": "work"}}} {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:31:39.626013 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-7a8d3a53-6743-45d0-901c-87930414be75 tempest-VolumesNegativeTest-408784968 tempest-VolumesNegativeTest-408784968-project] Request method failure captured: Sep 09 16:31:39.626013 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 09 16:31:39.626013 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Accept: application/json Sep 09 16:31:39.626013 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Accept-Encoding: identity Sep 09 16:31:39.626013 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Connection: close Sep 09 16:31:39.626013 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Content-Length: 121 Sep 09 16:31:39.626013 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Content-Type: application/json Sep 09 16:31:39.626013 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Host: 10.222.0.23 Sep 09 16:31:39.626013 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Openstack-System-Scope: None Sep 09 16:31:39.626013 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: User-Agent: python-urllib3/1.26.12 Sep 09 16:31:39.626013 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Auth-Token: gAAAAABjG2pqOm0omSPV75efpZWDsa32FAeLT-yKrT_yJwJK9_PUaQ-sjsd7UI2cC1mvqPaX01ZdDmpAPLKDrNDT2B1p7-RiMaoA_I0VBaaYC3nA9toWLzbgHywnF8daAITf7gpovayajaLBvbGsuwxiSblwcG7kzkgp3vBYgOqwISELyPS_woc Sep 09 16:31:39.626013 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Domain-Id: None Sep 09 16:31:39.626013 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Domain-Name: None Sep 09 16:31:39.626013 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Identity-Status: Confirmed Sep 09 16:31:39.626013 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Is-Admin-Project: True Sep 09 16:31:39.626013 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Project-Domain-Id: default Sep 09 16:31:39.626013 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Project-Domain-Name: Default Sep 09 16:31:39.626013 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Project-Id: 75e4208363cf47dfb52c9a5313068435 Sep 09 16:31:39.626013 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Project-Name: tempest-VolumesNegativeTest-408784968 Sep 09 16:31:39.626013 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Role: member,reader Sep 09 16:31:39.626013 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Roles: member,reader Sep 09 16:31:39.627826 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/75e4208363cf47dfb52c9a5313068435"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/75e4208363cf47dfb52c9a5313068435"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/75e4208363cf47dfb52c9a5313068435"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_75e4208363cf47dfb52c9a5313068435"}]}] Sep 09 16:31:39.627826 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Tenant: tempest-VolumesNegativeTest-408784968 Sep 09 16:31:39.627826 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Tenant-Id: 75e4208363cf47dfb52c9a5313068435 Sep 09 16:31:39.627826 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Tenant-Name: tempest-VolumesNegativeTest-408784968 Sep 09 16:31:39.627826 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-User: tempest-VolumesNegativeTest-408784968-project Sep 09 16:31:39.627826 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-User-Domain-Id: default Sep 09 16:31:39.627826 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-User-Domain-Name: Default Sep 09 16:31:39.627826 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-User-Id: a89acf33520f4842ad411207309ebf9e Sep 09 16:31:39.627826 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-User-Name: tempest-VolumesNegativeTest-408784968-project Sep 09 16:31:39.627826 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Sep 09 16:31:39.627826 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-917138627", "metadata": {"Type": "work"}}} Sep 09 16:31:39.627826 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: method: Sep 09 16:31:39.627826 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 09 16:31:39.628892 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-917138627', 'metadata': {'Type': 'work'}}}} Sep 09 16:31:39.628892 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 16:31:39.628892 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:31:39.628892 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 09 16:31:39.628892 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 09 16:31:39.628892 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 09 16:31:39.628892 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi raise error Sep 09 16:31:39.628892 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 09 16:31:39.628892 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Sep 09 16:31:39.628892 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 09 16:31:39.628892 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 09 16:31:39.628892 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Sep 09 16:31:39.628892 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 09 16:31:39.628892 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi '#$%' Sep 09 16:31:39.628892 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Sep 09 16:31:39.628892 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 16:31:39.628892 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Sep 09 16:31:39.628892 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:31:39.628892 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 16:31:39.628892 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 16:31:39.628892 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 16:31:39.628892 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 16:31:39.630606 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 16:31:39.630606 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 16:31:39.630606 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 16:31:39.630606 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 16:31:39.630606 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 09 16:31:39.630606 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 09 16:31:39.630606 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 09 16:31:39.630606 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 09 16:31:39.630606 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 09 16:31:39.630606 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 09 16:31:39.630606 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 09 16:31:39.630606 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Sep 09 16:31:39.630606 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 16:31:39.630606 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Sep 09 16:31:39.630606 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:31:39.630606 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 16:31:39.630606 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 16:31:39.630606 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 09 16:31:39.630606 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 09 16:31:39.632014 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 09 16:31:39.632014 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Sep 09 16:31:39.633248 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-7a8d3a53-6743-45d0-901c-87930414be75 tempest-VolumesNegativeTest-408784968 tempest-VolumesNegativeTest-408784968-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=127196) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 16:31:39.635260 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-7a8d3a53-6743-45d0-901c-87930414be75 tempest-VolumesNegativeTest-408784968 tempest-VolumesNegativeTest-408784968-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.269055 Sep 09 16:31:39.640308 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 1/1] 10.222.0.23 () {60 vars in 1156 bytes} [Fri Sep 9 16:31:38 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1276 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 09 16:31:39.649935 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_api:SELECT=3 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:31:39.651781 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell0:SELECT=3 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:31:39.652709 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell1:SELECT=3 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:31:39.653456 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell0:SELECT=3 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:31:40.024004 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-42beb39e-00a5-4dc7-b8cf-c5d8edd3bc4b tempest-VolumesNegativeTest-408784968 tempest-VolumesNegativeTest-408784968-project] Action: 'create', calling method: .version_select at 0x7f24fc6c1940>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-334870644", "metadata": {"Type": "work"}}} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:31:40.037182 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-42beb39e-00a5-4dc7-b8cf-c5d8edd3bc4b tempest-VolumesNegativeTest-408784968 tempest-VolumesNegativeTest-408784968-project] Request method failure captured: Sep 09 16:31:40.037182 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 09 16:31:40.037182 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Accept: application/json Sep 09 16:31:40.037182 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Accept-Encoding: identity Sep 09 16:31:40.037182 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Connection: close Sep 09 16:31:40.037182 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Content-Length: 119 Sep 09 16:31:40.037182 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Content-Type: application/json Sep 09 16:31:40.037182 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Host: 10.222.0.23 Sep 09 16:31:40.037182 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Openstack-System-Scope: None Sep 09 16:31:40.037182 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: User-Agent: python-urllib3/1.26.12 Sep 09 16:31:40.037182 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Auth-Token: gAAAAABjG2pqOm0omSPV75efpZWDsa32FAeLT-yKrT_yJwJK9_PUaQ-sjsd7UI2cC1mvqPaX01ZdDmpAPLKDrNDT2B1p7-RiMaoA_I0VBaaYC3nA9toWLzbgHywnF8daAITf7gpovayajaLBvbGsuwxiSblwcG7kzkgp3vBYgOqwISELyPS_woc Sep 09 16:31:40.037182 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Domain-Id: None Sep 09 16:31:40.037182 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Domain-Name: None Sep 09 16:31:40.037182 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Identity-Status: Confirmed Sep 09 16:31:40.037182 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Is-Admin-Project: True Sep 09 16:31:40.037182 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Project-Domain-Id: default Sep 09 16:31:40.037182 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Project-Domain-Name: Default Sep 09 16:31:40.037182 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Project-Id: 75e4208363cf47dfb52c9a5313068435 Sep 09 16:31:40.037182 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Project-Name: tempest-VolumesNegativeTest-408784968 Sep 09 16:31:40.037182 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Role: member,reader Sep 09 16:31:40.037182 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Roles: member,reader Sep 09 16:31:40.038692 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/75e4208363cf47dfb52c9a5313068435"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/75e4208363cf47dfb52c9a5313068435"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/75e4208363cf47dfb52c9a5313068435"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_75e4208363cf47dfb52c9a5313068435"}]}] Sep 09 16:31:40.038692 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Tenant: tempest-VolumesNegativeTest-408784968 Sep 09 16:31:40.038692 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Tenant-Id: 75e4208363cf47dfb52c9a5313068435 Sep 09 16:31:40.038692 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Tenant-Name: tempest-VolumesNegativeTest-408784968 Sep 09 16:31:40.038692 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User: tempest-VolumesNegativeTest-408784968-project Sep 09 16:31:40.038692 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User-Domain-Id: default Sep 09 16:31:40.038692 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User-Domain-Name: Default Sep 09 16:31:40.038692 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User-Id: a89acf33520f4842ad411207309ebf9e Sep 09 16:31:40.038692 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User-Name: tempest-VolumesNegativeTest-408784968-project Sep 09 16:31:40.038692 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Sep 09 16:31:40.038692 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-334870644", "metadata": {"Type": "work"}}} Sep 09 16:31:40.038692 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: method: Sep 09 16:31:40.038692 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 09 16:31:40.039488 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-334870644', 'metadata': {'Type': 'work'}}}} Sep 09 16:31:40.039488 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 16:31:40.039488 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:31:40.039488 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 09 16:31:40.039488 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 09 16:31:40.039488 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 09 16:31:40.039488 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise error Sep 09 16:31:40.039488 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 09 16:31:40.039488 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:31:40.039488 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 09 16:31:40.039488 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 09 16:31:40.039488 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:31:40.039488 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 09 16:31:40.039488 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi '0' Sep 09 16:31:40.039488 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:31:40.039488 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 16:31:40.039488 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:31:40.039488 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:31:40.039488 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 16:31:40.039488 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 16:31:40.039488 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 16:31:40.039488 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 16:31:40.040843 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 16:31:40.040843 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 16:31:40.040843 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 16:31:40.040843 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 16:31:40.040843 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 09 16:31:40.040843 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 09 16:31:40.040843 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 09 16:31:40.040843 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 09 16:31:40.040843 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 09 16:31:40.040843 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 09 16:31:40.040843 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 09 16:31:40.040843 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:31:40.040843 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 16:31:40.040843 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:31:40.040843 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:31:40.040843 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 16:31:40.040843 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 16:31:40.040843 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 09 16:31:40.040843 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 09 16:31:40.041952 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 09 16:31:40.041952 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:31:40.041952 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-42beb39e-00a5-4dc7-b8cf-c5d8edd3bc4b tempest-VolumesNegativeTest-408784968 tempest-VolumesNegativeTest-408784968-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=127198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 16:31:40.041952 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-42beb39e-00a5-4dc7-b8cf-c5d8edd3bc4b tempest-VolumesNegativeTest-408784968 tempest-VolumesNegativeTest-408784968-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.395271 Sep 09 16:31:40.042218 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 1/2] 10.222.0.23 () {60 vars in 1156 bytes} [Fri Sep 9 16:31:39 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 400 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 09 16:31:40.054097 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-0eec4350-06dc-4997-ab37-6fcf5f13a9b8 tempest-VolumesNegativeTest-408784968 tempest-VolumesNegativeTest-408784968-project] Action: 'create', calling method: .version_select at 0x7f24fc605ca0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1340262045", "metadata": {"Type": "work"}}} {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:31:40.058140 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-0eec4350-06dc-4997-ab37-6fcf5f13a9b8 tempest-VolumesNegativeTest-408784968 tempest-VolumesNegativeTest-408784968-project] Request method failure captured: Sep 09 16:31:40.058140 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 09 16:31:40.058140 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Accept: application/json Sep 09 16:31:40.058140 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Accept-Encoding: identity Sep 09 16:31:40.058140 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Connection: close Sep 09 16:31:40.058140 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Content-Length: 119 Sep 09 16:31:40.058140 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Content-Type: application/json Sep 09 16:31:40.058140 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Host: 10.222.0.23 Sep 09 16:31:40.058140 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Openstack-System-Scope: None Sep 09 16:31:40.058140 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: User-Agent: python-urllib3/1.26.12 Sep 09 16:31:40.058140 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Auth-Token: gAAAAABjG2pqOm0omSPV75efpZWDsa32FAeLT-yKrT_yJwJK9_PUaQ-sjsd7UI2cC1mvqPaX01ZdDmpAPLKDrNDT2B1p7-RiMaoA_I0VBaaYC3nA9toWLzbgHywnF8daAITf7gpovayajaLBvbGsuwxiSblwcG7kzkgp3vBYgOqwISELyPS_woc Sep 09 16:31:40.058140 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Domain-Id: None Sep 09 16:31:40.058140 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Domain-Name: None Sep 09 16:31:40.058140 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Identity-Status: Confirmed Sep 09 16:31:40.058140 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Is-Admin-Project: True Sep 09 16:31:40.058140 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Project-Domain-Id: default Sep 09 16:31:40.058140 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Project-Domain-Name: Default Sep 09 16:31:40.058140 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Project-Id: 75e4208363cf47dfb52c9a5313068435 Sep 09 16:31:40.058140 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Project-Name: tempest-VolumesNegativeTest-408784968 Sep 09 16:31:40.058140 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Role: member,reader Sep 09 16:31:40.058140 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Roles: member,reader Sep 09 16:31:40.059631 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/75e4208363cf47dfb52c9a5313068435"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/75e4208363cf47dfb52c9a5313068435"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/75e4208363cf47dfb52c9a5313068435"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_75e4208363cf47dfb52c9a5313068435"}]}] Sep 09 16:31:40.059631 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Tenant: tempest-VolumesNegativeTest-408784968 Sep 09 16:31:40.059631 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Tenant-Id: 75e4208363cf47dfb52c9a5313068435 Sep 09 16:31:40.059631 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Tenant-Name: tempest-VolumesNegativeTest-408784968 Sep 09 16:31:40.059631 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-User: tempest-VolumesNegativeTest-408784968-project Sep 09 16:31:40.059631 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-User-Domain-Id: default Sep 09 16:31:40.059631 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-User-Domain-Name: Default Sep 09 16:31:40.059631 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-User-Id: a89acf33520f4842ad411207309ebf9e Sep 09 16:31:40.059631 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-User-Name: tempest-VolumesNegativeTest-408784968-project Sep 09 16:31:40.059631 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Sep 09 16:31:40.059631 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1340262045", "metadata": {"Type": "work"}}} Sep 09 16:31:40.059631 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: method: Sep 09 16:31:40.059631 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 09 16:31:40.060418 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1340262045', 'metadata': {'Type': 'work'}}}} Sep 09 16:31:40.060418 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 16:31:40.060418 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:31:40.060418 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 09 16:31:40.060418 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 09 16:31:40.060418 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 09 16:31:40.060418 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi raise error Sep 09 16:31:40.060418 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 09 16:31:40.060418 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Sep 09 16:31:40.060418 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 09 16:31:40.060418 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 09 16:31:40.060418 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Sep 09 16:31:40.060418 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 09 16:31:40.060418 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi '' Sep 09 16:31:40.060418 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Sep 09 16:31:40.060418 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 16:31:40.060418 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Sep 09 16:31:40.060418 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:31:40.060418 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 16:31:40.060418 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 16:31:40.060418 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 16:31:40.060418 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 16:31:40.061678 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 16:31:40.061678 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 16:31:40.061678 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 16:31:40.061678 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 16:31:40.061678 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 09 16:31:40.061678 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 09 16:31:40.061678 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 09 16:31:40.061678 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 09 16:31:40.061678 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 09 16:31:40.061678 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 09 16:31:40.061678 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 09 16:31:40.061678 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Sep 09 16:31:40.061678 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 16:31:40.061678 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Sep 09 16:31:40.061678 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:31:40.061678 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 16:31:40.061678 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 16:31:40.061678 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 09 16:31:40.061678 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 09 16:31:40.062974 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 09 16:31:40.062974 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Sep 09 16:31:40.062974 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-0eec4350-06dc-4997-ab37-6fcf5f13a9b8 tempest-VolumesNegativeTest-408784968 tempest-VolumesNegativeTest-408784968-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=127196) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 16:31:40.062974 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-0eec4350-06dc-4997-ab37-6fcf5f13a9b8 tempest-VolumesNegativeTest-408784968 tempest-VolumesNegativeTest-408784968-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.013142 Sep 09 16:31:40.063343 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 2/3] 10.222.0.23 () {60 vars in 1156 bytes} [Fri Sep 9 16:31:40 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 09 16:31:40.075102 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-42808ebc-e949-4988-8f17-c951317311d9 tempest-VolumesNegativeTest-408784968 tempest-VolumesNegativeTest-408784968-project] Calling method '.version_select at 0x7f24fc65fdc0>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:31:40.492854 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-2f68ffeb-8337-4c3a-8b1a-ec512658e58a tempest-VolumesTestJSON-1081988870 tempest-VolumesTestJSON-1081988870-project] Calling method '.version_select at 0x7f24fc4c00d0>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:31:41.053318 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.wsgi [None req-42808ebc-e949-4988-8f17-c951317311d9 tempest-VolumesNegativeTest-408784968 tempest-VolumesNegativeTest-408784968-project] HTTP exception thrown: Volume tempest-invalid-1156778935 could not be found. Sep 09 16:31:41.064351 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-42808ebc-e949-4988-8f17-c951317311d9 tempest-VolumesNegativeTest-408784968 tempest-VolumesNegativeTest-408784968-project] Request method failure captured: Sep 09 16:31:41.064351 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1156778935 HTTP/1.1 Sep 09 16:31:41.064351 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Accept: application/json Sep 09 16:31:41.064351 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Accept-Encoding: identity Sep 09 16:31:41.064351 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Connection: close Sep 09 16:31:41.064351 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Content-Length: 0 Sep 09 16:31:41.064351 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Content-Type: application/json Sep 09 16:31:41.064351 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Host: 10.222.0.23 Sep 09 16:31:41.064351 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Openstack-System-Scope: None Sep 09 16:31:41.064351 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: User-Agent: python-urllib3/1.26.12 Sep 09 16:31:41.064351 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Auth-Token: gAAAAABjG2pqOm0omSPV75efpZWDsa32FAeLT-yKrT_yJwJK9_PUaQ-sjsd7UI2cC1mvqPaX01ZdDmpAPLKDrNDT2B1p7-RiMaoA_I0VBaaYC3nA9toWLzbgHywnF8daAITf7gpovayajaLBvbGsuwxiSblwcG7kzkgp3vBYgOqwISELyPS_woc Sep 09 16:31:41.064351 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Domain-Id: None Sep 09 16:31:41.064351 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Domain-Name: None Sep 09 16:31:41.064351 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Identity-Status: Confirmed Sep 09 16:31:41.064351 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Is-Admin-Project: True Sep 09 16:31:41.064351 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Project-Domain-Id: default Sep 09 16:31:41.064351 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Project-Domain-Name: Default Sep 09 16:31:41.064351 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Project-Id: 75e4208363cf47dfb52c9a5313068435 Sep 09 16:31:41.064351 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Project-Name: tempest-VolumesNegativeTest-408784968 Sep 09 16:31:41.064351 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Role: member,reader Sep 09 16:31:41.064351 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Roles: member,reader Sep 09 16:31:41.065697 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/75e4208363cf47dfb52c9a5313068435"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/75e4208363cf47dfb52c9a5313068435"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/75e4208363cf47dfb52c9a5313068435"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_75e4208363cf47dfb52c9a5313068435"}]}] Sep 09 16:31:41.065697 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Tenant: tempest-VolumesNegativeTest-408784968 Sep 09 16:31:41.065697 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Tenant-Id: 75e4208363cf47dfb52c9a5313068435 Sep 09 16:31:41.065697 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Tenant-Name: tempest-VolumesNegativeTest-408784968 Sep 09 16:31:41.065697 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User: tempest-VolumesNegativeTest-408784968-project Sep 09 16:31:41.065697 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User-Domain-Id: default Sep 09 16:31:41.065697 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User-Domain-Name: Default Sep 09 16:31:41.065697 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User-Id: a89acf33520f4842ad411207309ebf9e Sep 09 16:31:41.065697 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User-Name: tempest-VolumesNegativeTest-408784968-project Sep 09 16:31:41.065697 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: method: Sep 09 16:31:41.065697 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: exception: Volume tempest-invalid-1156778935 could not be found. Sep 09 16:31:41.065697 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: action_args: {'id': 'tempest-invalid-1156778935'} Sep 09 16:31:41.065697 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 16:31:41.066561 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:31:41.066561 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 16:31:41.066561 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 16:31:41.066561 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 09 16:31:41.066561 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 09 16:31:41.066561 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 09 16:31:41.066561 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 09 16:31:41.066561 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 09 16:31:41.066561 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 09 16:31:41.066561 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 09 16:31:41.066561 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 09 16:31:41.066561 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 16:31:41.066561 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 16:31:41.066561 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 16:31:41.066561 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 16:31:41.066561 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1156778935 could not be found. (HTTP 404) (Request-ID: req-de3f14f6-57c2-40ed-a6a5-75e71184f138) Sep 09 16:31:41.066561 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:31:41.066561 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 16:31:41.066561 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:31:41.073929 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:31:41.073929 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 09 16:31:41.073929 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 09 16:31:41.073929 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 09 16:31:41.073929 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 09 16:31:41.073929 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 09 16:31:41.073929 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 09 16:31:41.073929 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 09 16:31:41.073929 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 09 16:31:41.073929 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 16:31:41.073929 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 16:31:41.073929 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 09 16:31:41.073929 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 09 16:31:41.073929 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 09 16:31:41.073929 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 09 16:31:41.073929 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 09 16:31:41.073929 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 09 16:31:41.073929 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 09 16:31:41.073929 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 09 16:31:41.075594 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 16:31:41.075594 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 16:31:41.075594 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 16:31:41.075594 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 16:31:41.075594 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1156778935 could not be found. Sep 09 16:31:41.075594 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:31:41.075594 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 16:31:41.075594 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:31:41.075594 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:31:41.075594 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 16:31:41.075594 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 16:31:41.075594 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 16:31:41.075594 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 16:31:41.075594 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 16:31:41.075594 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 16:31:41.075594 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 16:31:41.075594 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 16:31:41.075594 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 09 16:31:41.075594 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 16:31:41.075594 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1156778935 could not be found. Sep 09 16:31:41.077166 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:31:41.077166 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 16:31:41.077166 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:31:41.077166 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:31:41.077166 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 16:31:41.077166 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 16:31:41.077166 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 16:31:41.077166 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 16:31:41.077166 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1156778935 could not be found. Sep 09 16:31:41.077166 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:31:41.077166 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-42808ebc-e949-4988-8f17-c951317311d9 tempest-VolumesNegativeTest-408784968 tempest-VolumesNegativeTest-408784968-project] Returning 404 to user: Volume tempest-invalid-1156778935 could not be found. {{(pid=127198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 16:31:41.077166 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-42808ebc-e949-4988-8f17-c951317311d9 tempest-VolumesNegativeTest-408784968 tempest-VolumesNegativeTest-408784968-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1156778935" status: 404 len: 99 microversion: 2.1 time: 0.996779 Sep 09 16:31:41.077166 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 2/4] 10.222.0.23 () {58 vars in 1218 bytes} [Fri Sep 9 16:31:40 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1156778935 => generated 99 bytes in 999 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 09 16:31:41.100928 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-42d1bb14-0c93-47b5-8a71-e1d361c2989b tempest-VolumesNegativeTest-408784968 tempest-VolumesNegativeTest-408784968-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.024436 Sep 09 16:31:41.103203 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 3/5] 10.222.0.23 () {58 vars in 1140 bytes} [Fri Sep 9 16:31:41 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 31 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 09 16:31:41.114639 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-511ddd8a-4d05-4b24-8fc3-4a620818b2ec tempest-VolumesNegativeTest-408784968 tempest-VolumesNegativeTest-408784968-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.007363 Sep 09 16:31:41.122831 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 4/6] 10.222.0.23 () {58 vars in 1137 bytes} [Fri Sep 9 16:31:41 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 15 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 09 16:31:41.129336 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-ab287677-ed57-4059-ab80-30c268511ff9 tempest-VolumesNegativeTest-408784968 tempest-VolumesNegativeTest-408784968-project] Calling method '.version_select at 0x7f24fc443c10>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:31:41.137641 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-2f68ffeb-8337-4c3a-8b1a-ec512658e58a tempest-VolumesTestJSON-1081988870 tempest-VolumesTestJSON-1081988870-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/f0e7b9a9-3235-4f60-b681-e7fa7425d496" status: 200 len: 350 microversion: 2.1 time: 0.657205 Sep 09 16:31:41.139045 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 3/7] 10.222.0.23 () {58 vars in 1245 bytes} [Fri Sep 9 16:31:40 2022] GET /compute/v2.1/os-volumes/f0e7b9a9-3235-4f60-b681-e7fa7425d496 => generated 350 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:31:41.175739 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.wsgi [None req-ab287677-ed57-4059-ab80-30c268511ff9 tempest-VolumesNegativeTest-408784968 tempest-VolumesNegativeTest-408784968-project] HTTP exception thrown: Volume ca57f725-1e6a-4da1-9035-1d1d1c95ca2d could not be found. Sep 09 16:31:41.178115 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-ab287677-ed57-4059-ab80-30c268511ff9 tempest-VolumesNegativeTest-408784968 tempest-VolumesNegativeTest-408784968-project] Request method failure captured: Sep 09 16:31:41.178115 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: request: DELETE /compute/v2.1/os-volumes/ca57f725-1e6a-4da1-9035-1d1d1c95ca2d HTTP/1.1 Sep 09 16:31:41.178115 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Accept: application/json Sep 09 16:31:41.178115 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Accept-Encoding: identity Sep 09 16:31:41.178115 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Connection: close Sep 09 16:31:41.178115 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Content-Length: 0 Sep 09 16:31:41.178115 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Content-Type: application/json Sep 09 16:31:41.178115 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Host: 10.222.0.23 Sep 09 16:31:41.178115 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Openstack-System-Scope: None Sep 09 16:31:41.178115 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: User-Agent: python-urllib3/1.26.12 Sep 09 16:31:41.178115 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Auth-Token: gAAAAABjG2pqOm0omSPV75efpZWDsa32FAeLT-yKrT_yJwJK9_PUaQ-sjsd7UI2cC1mvqPaX01ZdDmpAPLKDrNDT2B1p7-RiMaoA_I0VBaaYC3nA9toWLzbgHywnF8daAITf7gpovayajaLBvbGsuwxiSblwcG7kzkgp3vBYgOqwISELyPS_woc Sep 09 16:31:41.178115 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Domain-Id: None Sep 09 16:31:41.178115 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Domain-Name: None Sep 09 16:31:41.178115 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Identity-Status: Confirmed Sep 09 16:31:41.178115 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Is-Admin-Project: True Sep 09 16:31:41.178115 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Project-Domain-Id: default Sep 09 16:31:41.178115 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Project-Domain-Name: Default Sep 09 16:31:41.178115 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Project-Id: 75e4208363cf47dfb52c9a5313068435 Sep 09 16:31:41.178115 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Project-Name: tempest-VolumesNegativeTest-408784968 Sep 09 16:31:41.178115 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Role: member,reader Sep 09 16:31:41.178115 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Roles: member,reader Sep 09 16:31:41.179484 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/75e4208363cf47dfb52c9a5313068435"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/75e4208363cf47dfb52c9a5313068435"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/75e4208363cf47dfb52c9a5313068435"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_75e4208363cf47dfb52c9a5313068435"}]}] Sep 09 16:31:41.179484 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Tenant: tempest-VolumesNegativeTest-408784968 Sep 09 16:31:41.179484 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Tenant-Id: 75e4208363cf47dfb52c9a5313068435 Sep 09 16:31:41.179484 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Tenant-Name: tempest-VolumesNegativeTest-408784968 Sep 09 16:31:41.179484 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User: tempest-VolumesNegativeTest-408784968-project Sep 09 16:31:41.179484 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User-Domain-Id: default Sep 09 16:31:41.179484 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User-Domain-Name: Default Sep 09 16:31:41.179484 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User-Id: a89acf33520f4842ad411207309ebf9e Sep 09 16:31:41.179484 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User-Name: tempest-VolumesNegativeTest-408784968-project Sep 09 16:31:41.179484 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: method: Sep 09 16:31:41.179484 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: exception: Volume ca57f725-1e6a-4da1-9035-1d1d1c95ca2d could not be found. Sep 09 16:31:41.179484 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: action_args: {'id': 'ca57f725-1e6a-4da1-9035-1d1d1c95ca2d'} Sep 09 16:31:41.179484 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 16:31:41.180247 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:31:41.180247 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 16:31:41.180247 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 16:31:41.180247 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 09 16:31:41.180247 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 09 16:31:41.180247 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 09 16:31:41.180247 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 09 16:31:41.180247 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 09 16:31:41.180247 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 09 16:31:41.180247 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 09 16:31:41.180247 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 09 16:31:41.180247 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 16:31:41.180247 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 16:31:41.180247 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 16:31:41.180247 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 16:31:41.180247 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ca57f725-1e6a-4da1-9035-1d1d1c95ca2d could not be found. (HTTP 404) (Request-ID: req-731a92b0-0734-4c47-a244-550a5bfa617f) Sep 09 16:31:41.180247 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:31:41.180247 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 16:31:41.180247 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:31:41.181336 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:31:41.181336 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 09 16:31:41.181336 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 09 16:31:41.181336 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 09 16:31:41.181336 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 09 16:31:41.181336 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 09 16:31:41.181336 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 09 16:31:41.181336 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 09 16:31:41.181336 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 09 16:31:41.181336 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 16:31:41.181336 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 16:31:41.181336 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 09 16:31:41.181336 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 09 16:31:41.181336 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 09 16:31:41.181336 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 09 16:31:41.181336 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 09 16:31:41.181336 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 09 16:31:41.181336 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 09 16:31:41.181336 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 09 16:31:41.182480 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 16:31:41.182480 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 16:31:41.182480 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 16:31:41.182480 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 16:31:41.182480 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ca57f725-1e6a-4da1-9035-1d1d1c95ca2d could not be found. Sep 09 16:31:41.182480 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:31:41.182480 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 16:31:41.182480 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:31:41.182480 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:31:41.182480 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 16:31:41.182480 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 16:31:41.182480 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 16:31:41.182480 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 16:31:41.182480 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 16:31:41.182480 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 16:31:41.182480 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 16:31:41.182480 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 16:31:41.182480 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 09 16:31:41.182480 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 16:31:41.183605 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ca57f725-1e6a-4da1-9035-1d1d1c95ca2d could not be found. Sep 09 16:31:41.183605 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:31:41.183605 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 16:31:41.183605 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:31:41.183605 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:31:41.183605 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 16:31:41.183605 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 16:31:41.183605 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 16:31:41.183605 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 16:31:41.183605 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ca57f725-1e6a-4da1-9035-1d1d1c95ca2d could not be found. Sep 09 16:31:41.183605 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:31:41.183605 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-ab287677-ed57-4059-ab80-30c268511ff9 tempest-VolumesNegativeTest-408784968 tempest-VolumesNegativeTest-408784968-project] Returning 404 to user: Volume ca57f725-1e6a-4da1-9035-1d1d1c95ca2d could not be found. {{(pid=127198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 16:31:41.183605 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-ab287677-ed57-4059-ab80-30c268511ff9 tempest-VolumesNegativeTest-408784968 tempest-VolumesNegativeTest-408784968-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/ca57f725-1e6a-4da1-9035-1d1d1c95ca2d" status: 404 len: 109 microversion: 2.1 time: 0.055788 Sep 09 16:31:41.183605 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 5/8] 10.222.0.23 () {58 vars in 1248 bytes} [Fri Sep 9 16:31:41 2022] DELETE /compute/v2.1/os-volumes/ca57f725-1e6a-4da1-9035-1d1d1c95ca2d => generated 109 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 16:31:41.232395 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-0e5f24e8-b64e-4782-adfc-163770f681aa tempest-VolumesNegativeTest-408784968 tempest-VolumesNegativeTest-408784968-project] Calling method '.version_select at 0x7f24fc494820>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:31:41.243933 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.wsgi [None req-0e5f24e8-b64e-4782-adfc-163770f681aa tempest-VolumesNegativeTest-408784968 tempest-VolumesNegativeTest-408784968-project] HTTP exception thrown: Volume 4f0b8b12-102b-4255-bd30-f444730ad168 could not be found. Sep 09 16:31:41.249719 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-0e5f24e8-b64e-4782-adfc-163770f681aa tempest-VolumesNegativeTest-408784968 tempest-VolumesNegativeTest-408784968-project] Request method failure captured: Sep 09 16:31:41.249719 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: request: GET /compute/v2.1/os-volumes/4f0b8b12-102b-4255-bd30-f444730ad168 HTTP/1.1 Sep 09 16:31:41.249719 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Accept: application/json Sep 09 16:31:41.249719 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Accept-Encoding: identity Sep 09 16:31:41.249719 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Connection: close Sep 09 16:31:41.249719 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Content-Length: 0 Sep 09 16:31:41.249719 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Content-Type: application/json Sep 09 16:31:41.249719 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Host: 10.222.0.23 Sep 09 16:31:41.249719 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Openstack-System-Scope: None Sep 09 16:31:41.249719 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: User-Agent: python-urllib3/1.26.12 Sep 09 16:31:41.249719 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Auth-Token: gAAAAABjG2pqOm0omSPV75efpZWDsa32FAeLT-yKrT_yJwJK9_PUaQ-sjsd7UI2cC1mvqPaX01ZdDmpAPLKDrNDT2B1p7-RiMaoA_I0VBaaYC3nA9toWLzbgHywnF8daAITf7gpovayajaLBvbGsuwxiSblwcG7kzkgp3vBYgOqwISELyPS_woc Sep 09 16:31:41.249719 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Domain-Id: None Sep 09 16:31:41.249719 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Domain-Name: None Sep 09 16:31:41.249719 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Identity-Status: Confirmed Sep 09 16:31:41.249719 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Is-Admin-Project: True Sep 09 16:31:41.249719 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Project-Domain-Id: default Sep 09 16:31:41.249719 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Project-Domain-Name: Default Sep 09 16:31:41.249719 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Project-Id: 75e4208363cf47dfb52c9a5313068435 Sep 09 16:31:41.249719 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Project-Name: tempest-VolumesNegativeTest-408784968 Sep 09 16:31:41.249719 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Role: member,reader Sep 09 16:31:41.249719 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Roles: member,reader Sep 09 16:31:41.250965 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/75e4208363cf47dfb52c9a5313068435"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/75e4208363cf47dfb52c9a5313068435"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/75e4208363cf47dfb52c9a5313068435"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_75e4208363cf47dfb52c9a5313068435"}]}] Sep 09 16:31:41.250965 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Tenant: tempest-VolumesNegativeTest-408784968 Sep 09 16:31:41.250965 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Tenant-Id: 75e4208363cf47dfb52c9a5313068435 Sep 09 16:31:41.250965 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Tenant-Name: tempest-VolumesNegativeTest-408784968 Sep 09 16:31:41.250965 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-User: tempest-VolumesNegativeTest-408784968-project Sep 09 16:31:41.250965 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-User-Domain-Id: default Sep 09 16:31:41.250965 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-User-Domain-Name: Default Sep 09 16:31:41.250965 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-User-Id: a89acf33520f4842ad411207309ebf9e Sep 09 16:31:41.250965 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-User-Name: tempest-VolumesNegativeTest-408784968-project Sep 09 16:31:41.250965 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: method: Sep 09 16:31:41.250965 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: exception: Volume 4f0b8b12-102b-4255-bd30-f444730ad168 could not be found. Sep 09 16:31:41.250965 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: action_args: {'id': '4f0b8b12-102b-4255-bd30-f444730ad168'} Sep 09 16:31:41.250965 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 16:31:41.251756 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:31:41.251756 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 16:31:41.251756 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 16:31:41.251756 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 09 16:31:41.251756 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 09 16:31:41.251756 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 09 16:31:41.251756 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 09 16:31:41.251756 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 09 16:31:41.251756 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 09 16:31:41.251756 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 09 16:31:41.251756 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 09 16:31:41.251756 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 16:31:41.251756 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 16:31:41.251756 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 16:31:41.251756 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 16:31:41.251756 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4f0b8b12-102b-4255-bd30-f444730ad168 could not be found. (HTTP 404) (Request-ID: req-268b39bb-4ec2-4877-98c8-2bb3ddab1ed1) Sep 09 16:31:41.251756 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Sep 09 16:31:41.251756 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 16:31:41.251756 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Sep 09 16:31:41.252739 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:31:41.252739 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 09 16:31:41.252739 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 09 16:31:41.252739 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 09 16:31:41.252739 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 09 16:31:41.252739 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 09 16:31:41.252739 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 09 16:31:41.252739 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 09 16:31:41.252739 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 09 16:31:41.252739 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 16:31:41.252739 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 16:31:41.252739 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 09 16:31:41.252739 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 09 16:31:41.252739 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 09 16:31:41.252739 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 09 16:31:41.252739 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 09 16:31:41.252739 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 09 16:31:41.252739 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 09 16:31:41.252739 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 09 16:31:41.253732 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 16:31:41.253732 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 16:31:41.253732 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 16:31:41.253732 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 16:31:41.253732 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4f0b8b12-102b-4255-bd30-f444730ad168 could not be found. Sep 09 16:31:41.253732 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Sep 09 16:31:41.253732 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 16:31:41.253732 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Sep 09 16:31:41.253732 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:31:41.253732 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 16:31:41.253732 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 16:31:41.253732 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 16:31:41.253732 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 16:31:41.253732 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 16:31:41.253732 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 16:31:41.253732 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 16:31:41.253732 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 16:31:41.253732 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 09 16:31:41.253732 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 16:31:41.256958 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4f0b8b12-102b-4255-bd30-f444730ad168 could not be found. Sep 09 16:31:41.256958 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Sep 09 16:31:41.256958 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 16:31:41.256958 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Sep 09 16:31:41.256958 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:31:41.256958 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 16:31:41.256958 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 16:31:41.256958 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 16:31:41.256958 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 16:31:41.256958 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4f0b8b12-102b-4255-bd30-f444730ad168 could not be found. Sep 09 16:31:41.256958 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Sep 09 16:31:41.257735 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-0e5f24e8-b64e-4782-adfc-163770f681aa tempest-VolumesNegativeTest-408784968 tempest-VolumesNegativeTest-408784968-project] Returning 404 to user: Volume 4f0b8b12-102b-4255-bd30-f444730ad168 could not be found. {{(pid=127196) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 16:31:41.268783 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-0e5f24e8-b64e-4782-adfc-163770f681aa tempest-VolumesNegativeTest-408784968 tempest-VolumesNegativeTest-408784968-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/4f0b8b12-102b-4255-bd30-f444730ad168" status: 404 len: 109 microversion: 2.1 time: 0.072539 Sep 09 16:31:41.276191 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 4/9] 10.222.0.23 () {58 vars in 1245 bytes} [Fri Sep 9 16:31:41 2022] GET /compute/v2.1/os-volumes/4f0b8b12-102b-4255-bd30-f444730ad168 => generated 109 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 16:31:42.879463 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-acbe71c5-3277-4c60-84c5-499817e0eaf8 tempest-VolumesTestJSON-1081988870 tempest-VolumesTestJSON-1081988870-project] Calling method '.version_select at 0x7f24fc3eb9d0>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:31:43.186930 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-acbe71c5-3277-4c60-84c5-499817e0eaf8 tempest-VolumesTestJSON-1081988870 tempest-VolumesTestJSON-1081988870-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/cce48c90-ca4c-4b3b-84d8-9b0b739c40aa" status: 200 len: 351 microversion: 2.1 time: 0.312034 Sep 09 16:31:43.187885 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 6/10] 10.222.0.23 () {58 vars in 1245 bytes} [Fri Sep 9 16:31:42 2022] GET /compute/v2.1/os-volumes/cce48c90-ca4c-4b3b-84d8-9b0b739c40aa => generated 351 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:31:44.914943 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-3a373934-233f-4964-ae49-37f021c9bac4 tempest-VolumesTestJSON-1081988870 tempest-VolumesTestJSON-1081988870-project] Calling method '.version_select at 0x7f24fc494af0>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:31:45.004971 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-3a373934-233f-4964-ae49-37f021c9bac4 tempest-VolumesTestJSON-1081988870 tempest-VolumesTestJSON-1081988870-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/f7b43c29-90ab-4825-83a0-05f048246302" status: 200 len: 349 microversion: 2.1 time: 0.095109 Sep 09 16:31:45.013497 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 5/11] 10.222.0.23 () {58 vars in 1245 bytes} [Fri Sep 9 16:31:44 2022] GET /compute/v2.1/os-volumes/f7b43c29-90ab-4825-83a0-05f048246302 => generated 349 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:31:45.027646 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-8acde73a-9556-423e-b75e-4009573307df tempest-VolumesTestJSON-1081988870 tempest-VolumesTestJSON-1081988870-project] Calling method '.version_select at 0x7f24fc443b80>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:31:45.300317 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-8acde73a-9556-423e-b75e-4009573307df tempest-VolumesTestJSON-1081988870 tempest-VolumesTestJSON-1081988870-project] 10.222.0.23 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.284006 Sep 09 16:31:45.302169 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 7/12] 10.222.0.23 () {58 vars in 1134 bytes} [Fri Sep 9 16:31:45 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:31:45.318207 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-20a54d83-37fa-4504-afbb-13c7e293d71c tempest-VolumesTestJSON-1081988870 tempest-VolumesTestJSON-1081988870-project] Calling method '.version_select at 0x7f24fc3f15e0>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:31:45.525298 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-20a54d83-37fa-4504-afbb-13c7e293d71c tempest-VolumesTestJSON-1081988870 tempest-VolumesTestJSON-1081988870-project] 10.222.0.23 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.211260 Sep 09 16:31:45.527598 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 6/13] 10.222.0.23 () {58 vars in 1149 bytes} [Fri Sep 9 16:31:45 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:31:45.544353 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-dc549ce6-7a66-4f2d-804b-1431595dd0c8 tempest-VolumesTestJSON-1081988870 tempest-VolumesTestJSON-1081988870-project] Calling method '.version_select at 0x7f24fc3eb1f0>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:31:45.721665 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-dc549ce6-7a66-4f2d-804b-1431595dd0c8 tempest-VolumesTestJSON-1081988870 tempest-VolumesTestJSON-1081988870-project] 10.222.0.23 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.181466 Sep 09 16:31:45.722979 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 8/14] 10.222.0.23 () {58 vars in 1134 bytes} [Fri Sep 9 16:31:45 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:31:45.744153 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-de0c6a0c-46a9-403f-a55e-d471407cd749 tempest-VolumesTestJSON-1081988870 tempest-VolumesTestJSON-1081988870-project] Calling method '.version_select at 0x7f24fc3f1280>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:31:45.939730 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-de0c6a0c-46a9-403f-a55e-d471407cd749 tempest-VolumesTestJSON-1081988870 tempest-VolumesTestJSON-1081988870-project] 10.222.0.23 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.202726 Sep 09 16:31:45.940380 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 7/15] 10.222.0.23 () {58 vars in 1167 bytes} [Fri Sep 9 16:31:45 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:31:45.958487 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-9d2fb1fc-c097-4d1f-a55d-8f21728dcaa8 tempest-VolumesTestJSON-1081988870 tempest-VolumesTestJSON-1081988870-project] Calling method '.version_select at 0x7f24fc3f3f70>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:31:46.144984 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-9d2fb1fc-c097-4d1f-a55d-8f21728dcaa8 tempest-VolumesTestJSON-1081988870 tempest-VolumesTestJSON-1081988870-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.191103 Sep 09 16:31:46.148474 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 9/16] 10.222.0.23 () {58 vars in 1170 bytes} [Fri Sep 9 16:31:45 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:31:46.167453 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-da257ba8-b4eb-4597-9034-efb30eeeb231 tempest-VolumesTestJSON-1081988870 tempest-VolumesTestJSON-1081988870-project] Calling method '.version_select at 0x7f24fc3f89d0>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:31:46.376904 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-da257ba8-b4eb-4597-9034-efb30eeeb231 tempest-VolumesTestJSON-1081988870 tempest-VolumesTestJSON-1081988870-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.218512 Sep 09 16:31:46.379715 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 8/17] 10.222.0.23 () {58 vars in 1155 bytes} [Fri Sep 9 16:31:46 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:31:46.409884 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-ac971d9a-e87f-4849-9a78-c22cf0b86e32 tempest-VolumesTestJSON-1081988870 tempest-VolumesTestJSON-1081988870-project] Calling method '.version_select at 0x7f24fce328b0>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:31:46.622106 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-ac971d9a-e87f-4849-9a78-c22cf0b86e32 tempest-VolumesTestJSON-1081988870 tempest-VolumesTestJSON-1081988870-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.230251 Sep 09 16:31:46.622797 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 10/18] 10.222.0.23 () {58 vars in 1188 bytes} [Fri Sep 9 16:31:46 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:31:46.639534 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-f91518dc-fe06-4cfb-939e-7d7a8a55c426 tempest-VolumesTestJSON-1081988870 tempest-VolumesTestJSON-1081988870-project] Calling method '.version_select at 0x7f24fc3f8790>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:31:46.878148 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-f91518dc-fe06-4cfb-939e-7d7a8a55c426 tempest-VolumesTestJSON-1081988870 tempest-VolumesTestJSON-1081988870-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.242697 Sep 09 16:31:46.892127 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 9/19] 10.222.0.23 () {58 vars in 1155 bytes} [Fri Sep 9 16:31:46 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:31:54.330765 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-3e082c13-7c3c-4254-a282-b96c3878e0dd tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Action: 'create', calling method: .version_select at 0x7f24fc3eb790>, body: {"keypair": {"name": "tempest-keypair-607968590", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPs0YA/f1zIjPvky0Sc+9t187UUOD3dqfLryr305j5FWcxrTwlpw0MHtD29C45aOj7UkTQ9HzlDgDYUIXnZ0BO8+TnbyNKURKZcr6RuHxdQCv9xzxklAJMW+RPnhvlp+aw=="}} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:31:54.561208 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.quota [None req-3e082c13-7c3c-4254-a282-b96c3878e0dd tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Getting quotas for project f90f2e0c002343d88ae25dc7bfb2fe10. Resources: {'key_pairs'} {{(pid=127198) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 16:31:54.610784 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.quota [None req-3e082c13-7c3c-4254-a282-b96c3878e0dd tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Getting quotas for user d095ed814b9e47e08d6b5a4fd2901c43 and project f90f2e0c002343d88ae25dc7bfb2fe10. Resources: {'key_pairs'} {{(pid=127198) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 16:31:54.901144 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-3e082c13-7c3c-4254-a282-b96c3878e0dd tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.430095 Sep 09 16:31:54.902083 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 11/20] 10.222.0.23 () {60 vars in 1159 bytes} [Fri Sep 9 16:31:53 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1432 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:31:56.392063 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-ffe7b2ab-ec19-4406-a82d-ff59eac7d832 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-47653119", "imageRef": "0b1ba34f-2223-497a-9a18-c2ad8d398aae", "flavorRef": "452", "networks": [{"uuid": "19ac7dec-4e37-4795-8b35-6385094c30eb"}]}} {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:31:56.651446 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.network.neutron [None req-ffe7b2ab-ec19-4406-a82d-ff59eac7d832 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] validate_networks() for [('19ac7dec-4e37-4795-8b35-6385094c30eb', None, None, None, None, None)] {{(pid=127196) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 16:31:56.914617 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-2626bb8d-583a-4895-b6a9-417872d4f0e5 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Action: 'create', calling method: .version_select at 0x7f24fc3c4160>, body: {"keypair": {"name": "tempest-keypair-882262566", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH2vGN5sYeKIDO35Ra9E+M1tE9eUkefqygFIiReMCvVLW9H6GmaLfaZcVM0FSHE8r/MNGSjEi7yU7Das4P1A/vUqzhHynkMUXeO9mTxv+BkX17HXN0zt85DzCSRptRISTg=="}} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:31:56.982736 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.quota [None req-2626bb8d-583a-4895-b6a9-417872d4f0e5 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Getting quotas for project e17967a941be4a04bbc180e2cf3a7a55. Resources: {'key_pairs'} {{(pid=127198) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 16:31:56.996883 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.quota [None req-2626bb8d-583a-4895-b6a9-417872d4f0e5 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Getting quotas for user 53c0721dc18343b18993ff5af098841d and project e17967a941be4a04bbc180e2cf3a7a55. Resources: {'key_pairs'} {{(pid=127198) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 16:31:57.089309 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-2626bb8d-583a-4895-b6a9-417872d4f0e5 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.698482 Sep 09 16:31:57.089932 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 12/21] 10.222.0.23 () {60 vars in 1159 bytes} [Fri Sep 9 16:31:56 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 16:31:59.208977 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.virt.hardware [None req-ffe7b2ab-ec19-4406-a82d-ff59eac7d832 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Flavor limits 0:0:0 {{(pid=127196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 16:31:59.209466 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.virt.hardware [None req-ffe7b2ab-ec19-4406-a82d-ff59eac7d832 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Image limits 0:0:0 {{(pid=127196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 16:31:59.210989 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.virt.hardware [None req-ffe7b2ab-ec19-4406-a82d-ff59eac7d832 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Flavor pref 0:0:0 {{(pid=127196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 16:31:59.211420 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.virt.hardware [None req-ffe7b2ab-ec19-4406-a82d-ff59eac7d832 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Image pref 0:0:0 {{(pid=127196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 16:31:59.212558 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.virt.hardware [None req-ffe7b2ab-ec19-4406-a82d-ff59eac7d832 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 16:31:59.253350 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-ffe7b2ab-ec19-4406-a82d-ff59eac7d832 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:31:59.256903 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-ffe7b2ab-ec19-4406-a82d-ff59eac7d832 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:31:59.257729 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-ffe7b2ab-ec19-4406-a82d-ff59eac7d832 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:31:59.260292 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-ffe7b2ab-ec19-4406-a82d-ff59eac7d832 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:31:59.260911 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-ffe7b2ab-ec19-4406-a82d-ff59eac7d832 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:31:59.261539 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-ffe7b2ab-ec19-4406-a82d-ff59eac7d832 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:31:59.354273 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.quota [None req-ffe7b2ab-ec19-4406-a82d-ff59eac7d832 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Getting quotas for project 1f227ee89ce84dec84410a1db9b479fc. Resources: {'cores', 'instances', 'ram'} {{(pid=127196) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 16:31:59.383051 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.quota [None req-ffe7b2ab-ec19-4406-a82d-ff59eac7d832 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Getting quotas for user 1ce1cd9c19584549b794df8e487abf00 and project 1f227ee89ce84dec84410a1db9b479fc. Resources: {'cores', 'instances', 'ram'} {{(pid=127196) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 16:31:59.424100 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-ffe7b2ab-ec19-4406-a82d-ff59eac7d832 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Going to run 1 instances... {{(pid=127196) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 16:31:59.429294 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-ffe7b2ab-ec19-4406-a82d-ff59eac7d832 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] [instance: 15d68c64-0569-4afa-a718-bc0e0c2cba3e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0b1ba34f-2223-497a-9a18-c2ad8d398aae',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127196) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 16:31:59.445601 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-ce4a480b-d95f-4a9a-86b0-770cc32349f0 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1723892403", "imageRef": "0b1ba34f-2223-497a-9a18-c2ad8d398aae", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:31:59.559707 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-ffe7b2ab-ec19-4406-a82d-ff59eac7d832 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.874045 Sep 09 16:31:59.564486 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 10/22] 10.222.0.23 () {60 vars in 1147 bytes} [Fri Sep 9 16:31:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 3879 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 16:31:59.574371 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-168f0a3f-33fb-434e-831c-a79130aae8a6 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:31:59.575021 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-168f0a3f-33fb-434e-831c-a79130aae8a6 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] [instance: 15d68c64-0569-4afa-a718-bc0e0c2cba3e] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:31:59.623025 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.network.neutron [None req-ce4a480b-d95f-4a9a-86b0-770cc32349f0 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] validate_networks() for [('7b6e2f92-02dd-4b2d-b845-fc9ca1be737b', None, None, None, None, None)] {{(pid=127198) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 16:32:00.165451 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-168f0a3f-33fb-434e-831c-a79130aae8a6 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce1cd9c19584549b794df8e487abf00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f227ee89ce84dec84410a1db9b479fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:32:00.226778 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-168f0a3f-33fb-434e-831c-a79130aae8a6 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] 10.222.0.23 "GET /compute/v2.1/servers/15d68c64-0569-4afa-a718-bc0e0c2cba3e" status: 200 len: 1213 microversion: 2.1 time: 0.653313 Sep 09 16:32:00.257804 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 11/23] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:31:59 2022] GET /compute/v2.1/servers/15d68c64-0569-4afa-a718-bc0e0c2cba3e => generated 1213 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:32:00.284177 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-c029dadd-8a2e-42e9-95fa-b1e7a718b444 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1276500118", "imageRef": "0b1ba34f-2223-497a-9a18-c2ad8d398aae", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "80eeb587-e34e-4396-bf26-1f500780ff13"}], "security_groups": [{"name": "tempest-securitygroup--651484729"}], "key_name": "tempest-keypair-607968590", "user_data": "}} {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:32:00.941185 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.network.neutron [None req-c029dadd-8a2e-42e9-95fa-b1e7a718b444 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] validate_networks() for [('80eeb587-e34e-4396-bf26-1f500780ff13', None, None, None, None, None)] {{(pid=127196) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 16:32:02.320197 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.virt.hardware [None req-c029dadd-8a2e-42e9-95fa-b1e7a718b444 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Flavor limits 0:0:0 {{(pid=127196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 16:32:02.321555 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.virt.hardware [None req-c029dadd-8a2e-42e9-95fa-b1e7a718b444 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Image limits 0:0:0 {{(pid=127196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 16:32:02.322594 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.virt.hardware [None req-c029dadd-8a2e-42e9-95fa-b1e7a718b444 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Flavor pref 0:0:0 {{(pid=127196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 16:32:02.323209 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.virt.hardware [None req-c029dadd-8a2e-42e9-95fa-b1e7a718b444 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Image pref 0:0:0 {{(pid=127196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 16:32:02.323831 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.virt.hardware [None req-c029dadd-8a2e-42e9-95fa-b1e7a718b444 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 16:32:02.347931 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-c029dadd-8a2e-42e9-95fa-b1e7a718b444 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:02.348470 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-c029dadd-8a2e-42e9-95fa-b1e7a718b444 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:02.348885 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-c029dadd-8a2e-42e9-95fa-b1e7a718b444 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:02.349642 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-c029dadd-8a2e-42e9-95fa-b1e7a718b444 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:02.350086 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-c029dadd-8a2e-42e9-95fa-b1e7a718b444 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:02.350526 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-c029dadd-8a2e-42e9-95fa-b1e7a718b444 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:02.388806 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.quota [None req-c029dadd-8a2e-42e9-95fa-b1e7a718b444 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Getting quotas for project f90f2e0c002343d88ae25dc7bfb2fe10. Resources: {'cores', 'instances', 'ram'} {{(pid=127196) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 16:32:02.396668 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.quota [None req-c029dadd-8a2e-42e9-95fa-b1e7a718b444 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Getting quotas for user d095ed814b9e47e08d6b5a4fd2901c43 and project f90f2e0c002343d88ae25dc7bfb2fe10. Resources: {'cores', 'instances', 'ram'} {{(pid=127196) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 16:32:02.426048 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-c029dadd-8a2e-42e9-95fa-b1e7a718b444 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Going to run 1 instances... {{(pid=127196) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 16:32:02.428905 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-c029dadd-8a2e-42e9-95fa-b1e7a718b444 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] [instance: 9e761961-9c74-444c-bb4b-0b2f82a9d698] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0b1ba34f-2223-497a-9a18-c2ad8d398aae',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127196) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 16:32:02.566956 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-c029dadd-8a2e-42e9-95fa-b1e7a718b444 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.307644 Sep 09 16:32:02.572017 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 12/24] 10.222.0.23 () {60 vars in 1147 bytes} [Fri Sep 9 16:32:00 2022] POST /compute/v2.1/servers => generated 401 bytes in 2313 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 16:32:02.579286 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-842b380a-f5bc-4b21-9947-aeb401cddcf3 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:32:02.585549 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-842b380a-f5bc-4b21-9947-aeb401cddcf3 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] [instance: 15d68c64-0569-4afa-a718-bc0e0c2cba3e] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:32:02.589206 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-ce4a480b-d95f-4a9a-86b0-770cc32349f0 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Flavor limits 0:0:0 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 16:32:02.589702 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-ce4a480b-d95f-4a9a-86b0-770cc32349f0 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Image limits 0:0:0 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 16:32:02.590150 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-ce4a480b-d95f-4a9a-86b0-770cc32349f0 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Flavor pref 0:0:0 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 16:32:02.590588 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-ce4a480b-d95f-4a9a-86b0-770cc32349f0 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Image pref 0:0:0 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 16:32:02.591010 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-ce4a480b-d95f-4a9a-86b0-770cc32349f0 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 16:32:02.593933 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-842b380a-f5bc-4b21-9947-aeb401cddcf3 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:02.594704 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-842b380a-f5bc-4b21-9947-aeb401cddcf3 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:02.595632 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-842b380a-f5bc-4b21-9947-aeb401cddcf3 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:02.596560 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-842b380a-f5bc-4b21-9947-aeb401cddcf3 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:02.597214 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-842b380a-f5bc-4b21-9947-aeb401cddcf3 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:02.598019 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-842b380a-f5bc-4b21-9947-aeb401cddcf3 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:02.632424 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ce4a480b-d95f-4a9a-86b0-770cc32349f0 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:02.640723 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ce4a480b-d95f-4a9a-86b0-770cc32349f0 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:02.641273 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ce4a480b-d95f-4a9a-86b0-770cc32349f0 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:02.642085 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ce4a480b-d95f-4a9a-86b0-770cc32349f0 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:02.642585 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ce4a480b-d95f-4a9a-86b0-770cc32349f0 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:02.643012 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ce4a480b-d95f-4a9a-86b0-770cc32349f0 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:02.724073 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.quota [None req-ce4a480b-d95f-4a9a-86b0-770cc32349f0 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Getting quotas for project d21ab544d0b547919794e3efb49ba0e9. Resources: {'cores', 'instances', 'ram'} {{(pid=127198) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 16:32:02.741064 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.quota [None req-ce4a480b-d95f-4a9a-86b0-770cc32349f0 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Getting quotas for user 67d86f09c6304121be2021cb5c15e63e and project d21ab544d0b547919794e3efb49ba0e9. Resources: {'cores', 'instances', 'ram'} {{(pid=127198) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 16:32:02.779935 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-ce4a480b-d95f-4a9a-86b0-770cc32349f0 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Going to run 1 instances... {{(pid=127198) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 16:32:02.796776 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-ce4a480b-d95f-4a9a-86b0-770cc32349f0 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: cc41312a-3de8-4584-9bcf-a1f31b952025] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0b1ba34f-2223-497a-9a18-c2ad8d398aae',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127198) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 16:32:02.896352 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-842b380a-f5bc-4b21-9947-aeb401cddcf3 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce1cd9c19584549b794df8e487abf00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f227ee89ce84dec84410a1db9b479fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:32:02.920994 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-842b380a-f5bc-4b21-9947-aeb401cddcf3 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] 10.222.0.23 "GET /compute/v2.1/servers/15d68c64-0569-4afa-a718-bc0e0c2cba3e" status: 200 len: 1217 microversion: 2.1 time: 0.347557 Sep 09 16:32:02.955327 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 13/25] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:32:02 2022] GET /compute/v2.1/servers/15d68c64-0569-4afa-a718-bc0e0c2cba3e => generated 1217 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:32:02.991378 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-9c0eaba8-f36f-4a0f-8bfd-727ded29c914 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-952537783", "imageRef": "0b1ba34f-2223-497a-9a18-c2ad8d398aae", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5831de5e-0ff3-4415-b956-35183f0be5e2"}], "security_groups": [{"name": "tempest-securitygroup--1619131841"}], "key_name": "tempest-keypair-882262566", "user_data": "}} {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:32:03.123822 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-ce4a480b-d95f-4a9a-86b0-770cc32349f0 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.167933 Sep 09 16:32:03.132277 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 13/26] 10.222.0.23 () {60 vars in 1147 bytes} [Fri Sep 9 16:31:58 2022] POST /compute/v2.1/servers => generated 383 bytes in 4185 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 09 16:32:03.141613 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-4a75af18-7d32-4372-995d-738147e9b329 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:32:03.145621 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-4a75af18-7d32-4372-995d-738147e9b329 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] [instance: 9e761961-9c74-444c-bb4b-0b2f82a9d698] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:32:03.422033 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.network.neutron [None req-9c0eaba8-f36f-4a0f-8bfd-727ded29c914 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] validate_networks() for [('5831de5e-0ff3-4415-b956-35183f0be5e2', None, None, None, None, None)] {{(pid=127196) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 16:32:03.479155 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-4a75af18-7d32-4372-995d-738147e9b329 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd095ed814b9e47e08d6b5a4fd2901c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f2e0c002343d88ae25dc7bfb2fe10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:32:03.548821 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-4a75af18-7d32-4372-995d-738147e9b329 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] 10.222.0.23 "GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698" status: 200 len: 1237 microversion: 2.1 time: 0.414129 Sep 09 16:32:03.550450 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 14/27] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:32:03 2022] GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698 => generated 1237 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:32:03.564299 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-06969ca6-e598-4344-bff5-c4bb47f5900c tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:32:03.565644 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-06969ca6-e598-4344-bff5-c4bb47f5900c tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: cc41312a-3de8-4584-9bcf-a1f31b952025] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:32:03.719277 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-06969ca6-e598-4344-bff5-c4bb47f5900c tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d86f09c6304121be2021cb5c15e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ab544d0b547919794e3efb49ba0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:32:03.731593 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-06969ca6-e598-4344-bff5-c4bb47f5900c tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/cc41312a-3de8-4584-9bcf-a1f31b952025" status: 200 len: 1222 microversion: 2.1 time: 0.178576 Sep 09 16:32:03.733038 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 15/28] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:32:03 2022] GET /compute/v2.1/servers/cc41312a-3de8-4584-9bcf-a1f31b952025 => generated 1222 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:32:03.947939 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-c18db3e0-6338-4e89-a157-a3aebfa27953 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:32:03.948603 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-c18db3e0-6338-4e89-a157-a3aebfa27953 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] [instance: 15d68c64-0569-4afa-a718-bc0e0c2cba3e] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:32:03.967165 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c18db3e0-6338-4e89-a157-a3aebfa27953 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:03.968661 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c18db3e0-6338-4e89-a157-a3aebfa27953 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:03.971040 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c18db3e0-6338-4e89-a157-a3aebfa27953 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:03.984067 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c18db3e0-6338-4e89-a157-a3aebfa27953 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:03.988636 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c18db3e0-6338-4e89-a157-a3aebfa27953 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:03.990666 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c18db3e0-6338-4e89-a157-a3aebfa27953 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:04.392371 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-c18db3e0-6338-4e89-a157-a3aebfa27953 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce1cd9c19584549b794df8e487abf00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f227ee89ce84dec84410a1db9b479fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:32:04.421680 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-c18db3e0-6338-4e89-a157-a3aebfa27953 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] 10.222.0.23 "GET /compute/v2.1/servers/15d68c64-0569-4afa-a718-bc0e0c2cba3e" status: 200 len: 1283 microversion: 2.1 time: 0.479230 Sep 09 16:32:04.423940 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 16/29] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:32:03 2022] GET /compute/v2.1/servers/15d68c64-0569-4afa-a718-bc0e0c2cba3e => generated 1283 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 16:32:04.435478 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-bdc2b5fd-e8a9-4f7a-99d1-ce35d52a60c5 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1149680801", "imageRef": "0b1ba34f-2223-497a-9a18-c2ad8d398aae", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:32:04.605534 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.network.neutron [None req-bdc2b5fd-e8a9-4f7a-99d1-ce35d52a60c5 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] validate_networks() for [('7b6e2f92-02dd-4b2d-b845-fc9ca1be737b', None, None, None, None, None)] {{(pid=127198) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 16:32:05.264160 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.virt.hardware [None req-9c0eaba8-f36f-4a0f-8bfd-727ded29c914 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Flavor limits 0:0:0 {{(pid=127196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 16:32:05.265266 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.virt.hardware [None req-9c0eaba8-f36f-4a0f-8bfd-727ded29c914 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Image limits 0:0:0 {{(pid=127196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 16:32:05.265790 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.virt.hardware [None req-9c0eaba8-f36f-4a0f-8bfd-727ded29c914 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Flavor pref 0:0:0 {{(pid=127196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 16:32:05.266220 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.virt.hardware [None req-9c0eaba8-f36f-4a0f-8bfd-727ded29c914 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Image pref 0:0:0 {{(pid=127196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 16:32:05.266973 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.virt.hardware [None req-9c0eaba8-f36f-4a0f-8bfd-727ded29c914 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 16:32:05.281946 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-9c0eaba8-f36f-4a0f-8bfd-727ded29c914 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:05.288694 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-9c0eaba8-f36f-4a0f-8bfd-727ded29c914 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:05.289757 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-9c0eaba8-f36f-4a0f-8bfd-727ded29c914 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:05.292566 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-9c0eaba8-f36f-4a0f-8bfd-727ded29c914 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:05.293995 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-9c0eaba8-f36f-4a0f-8bfd-727ded29c914 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:05.294795 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-9c0eaba8-f36f-4a0f-8bfd-727ded29c914 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:05.369681 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.quota [None req-9c0eaba8-f36f-4a0f-8bfd-727ded29c914 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Getting quotas for project e17967a941be4a04bbc180e2cf3a7a55. Resources: {'cores', 'instances', 'ram'} {{(pid=127196) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 16:32:05.400075 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.quota [None req-9c0eaba8-f36f-4a0f-8bfd-727ded29c914 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Getting quotas for user 53c0721dc18343b18993ff5af098841d and project e17967a941be4a04bbc180e2cf3a7a55. Resources: {'cores', 'instances', 'ram'} {{(pid=127196) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 16:32:05.461754 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-9c0eaba8-f36f-4a0f-8bfd-727ded29c914 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Going to run 1 instances... {{(pid=127196) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 16:32:05.473888 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-9c0eaba8-f36f-4a0f-8bfd-727ded29c914 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] [instance: c453c474-644e-4e46-9d23-b2b87716f5d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0b1ba34f-2223-497a-9a18-c2ad8d398aae',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127196) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 16:32:05.634230 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-9c0eaba8-f36f-4a0f-8bfd-727ded29c914 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.677222 Sep 09 16:32:05.645275 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 14/30] 10.222.0.23 () {60 vars in 1147 bytes} [Fri Sep 9 16:32:02 2022] POST /compute/v2.1/servers => generated 402 bytes in 2689 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 16:32:05.655572 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-12c57ce0-a0f1-4841-aecd-0d2bfad3650e tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:32:05.664700 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-12c57ce0-a0f1-4841-aecd-0d2bfad3650e tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] [instance: 9e761961-9c74-444c-bb4b-0b2f82a9d698] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:32:05.690899 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-12c57ce0-a0f1-4841-aecd-0d2bfad3650e tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:05.691186 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-12c57ce0-a0f1-4841-aecd-0d2bfad3650e tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:05.692835 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-12c57ce0-a0f1-4841-aecd-0d2bfad3650e tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:05.695630 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-12c57ce0-a0f1-4841-aecd-0d2bfad3650e tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:05.697584 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-12c57ce0-a0f1-4841-aecd-0d2bfad3650e tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:05.698163 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-12c57ce0-a0f1-4841-aecd-0d2bfad3650e tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:07.582688 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-12c57ce0-a0f1-4841-aecd-0d2bfad3650e tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd095ed814b9e47e08d6b5a4fd2901c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f2e0c002343d88ae25dc7bfb2fe10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:32:07.593880 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-12c57ce0-a0f1-4841-aecd-0d2bfad3650e tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] 10.222.0.23 "GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698" status: 200 len: 1289 microversion: 2.1 time: 1.947185 Sep 09 16:32:07.602709 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 15/31] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:32:05 2022] GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698 => generated 1289 bytes in 1957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:32:07.620308 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-bfa23699-39ec-4053-9203-93478eb037d3 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:32:07.628400 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-bfa23699-39ec-4053-9203-93478eb037d3 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] [instance: 15d68c64-0569-4afa-a718-bc0e0c2cba3e] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:32:07.641879 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-bfa23699-39ec-4053-9203-93478eb037d3 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:07.648693 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-bfa23699-39ec-4053-9203-93478eb037d3 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:07.649760 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-bfa23699-39ec-4053-9203-93478eb037d3 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:07.655361 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-bfa23699-39ec-4053-9203-93478eb037d3 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:07.656043 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-bfa23699-39ec-4053-9203-93478eb037d3 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:07.656626 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-bfa23699-39ec-4053-9203-93478eb037d3 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:08.121464 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-bdc2b5fd-e8a9-4f7a-99d1-ce35d52a60c5 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Flavor limits 0:0:0 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 16:32:08.131273 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-bdc2b5fd-e8a9-4f7a-99d1-ce35d52a60c5 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Image limits 0:0:0 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 16:32:08.131273 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-bdc2b5fd-e8a9-4f7a-99d1-ce35d52a60c5 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Flavor pref 0:0:0 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 16:32:08.131273 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-bdc2b5fd-e8a9-4f7a-99d1-ce35d52a60c5 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Image pref 0:0:0 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 16:32:08.131273 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-bdc2b5fd-e8a9-4f7a-99d1-ce35d52a60c5 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 16:32:08.164926 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-bdc2b5fd-e8a9-4f7a-99d1-ce35d52a60c5 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:08.165684 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-bdc2b5fd-e8a9-4f7a-99d1-ce35d52a60c5 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:08.169031 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-bdc2b5fd-e8a9-4f7a-99d1-ce35d52a60c5 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:08.173800 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-bdc2b5fd-e8a9-4f7a-99d1-ce35d52a60c5 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:08.181652 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-bdc2b5fd-e8a9-4f7a-99d1-ce35d52a60c5 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:08.182484 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-bdc2b5fd-e8a9-4f7a-99d1-ce35d52a60c5 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:08.279144 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.quota [None req-bdc2b5fd-e8a9-4f7a-99d1-ce35d52a60c5 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Getting quotas for project d21ab544d0b547919794e3efb49ba0e9. Resources: {'cores', 'instances', 'ram'} {{(pid=127198) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 16:32:08.297535 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.quota [None req-bdc2b5fd-e8a9-4f7a-99d1-ce35d52a60c5 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Getting quotas for user 67d86f09c6304121be2021cb5c15e63e and project d21ab544d0b547919794e3efb49ba0e9. Resources: {'cores', 'instances', 'ram'} {{(pid=127198) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 16:32:08.349798 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-bdc2b5fd-e8a9-4f7a-99d1-ce35d52a60c5 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Going to run 1 instances... {{(pid=127198) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 16:32:08.356095 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-bdc2b5fd-e8a9-4f7a-99d1-ce35d52a60c5 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: e8d23cb3-2f39-4b00-ae9d-006e392a5940] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0b1ba34f-2223-497a-9a18-c2ad8d398aae',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127198) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 16:32:08.412827 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-bfa23699-39ec-4053-9203-93478eb037d3 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce1cd9c19584549b794df8e487abf00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f227ee89ce84dec84410a1db9b479fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:32:08.429273 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-bfa23699-39ec-4053-9203-93478eb037d3 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] 10.222.0.23 "GET /compute/v2.1/servers/15d68c64-0569-4afa-a718-bc0e0c2cba3e" status: 200 len: 1271 microversion: 2.1 time: 0.823276 Sep 09 16:32:08.438463 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 16/32] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:32:07 2022] GET /compute/v2.1/servers/15d68c64-0569-4afa-a718-bc0e0c2cba3e => generated 1271 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:32:08.481339 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-2e6b71bf-318b-4396-9656-045cacd09f18 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:32:08.493454 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-2e6b71bf-318b-4396-9656-045cacd09f18 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] [instance: c453c474-644e-4e46-9d23-b2b87716f5d7] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:32:08.527705 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-2e6b71bf-318b-4396-9656-045cacd09f18 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:08.534074 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-2e6b71bf-318b-4396-9656-045cacd09f18 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:08.534832 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-2e6b71bf-318b-4396-9656-045cacd09f18 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:08.535760 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-2e6b71bf-318b-4396-9656-045cacd09f18 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:08.538102 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-2e6b71bf-318b-4396-9656-045cacd09f18 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:08.540452 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-2e6b71bf-318b-4396-9656-045cacd09f18 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:08.592339 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-bdc2b5fd-e8a9-4f7a-99d1-ce35d52a60c5 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.166634 Sep 09 16:32:08.596713 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 17/33] 10.222.0.23 () {60 vars in 1147 bytes} [Fri Sep 9 16:32:04 2022] POST /compute/v2.1/servers => generated 383 bytes in 4172 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 16:32:08.615565 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-43f38cfe-ccf1-429d-8186-27a8b51f5f01 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:32:08.617934 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-43f38cfe-ccf1-429d-8186-27a8b51f5f01 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: e8d23cb3-2f39-4b00-ae9d-006e392a5940] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:32:09.125577 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-43f38cfe-ccf1-429d-8186-27a8b51f5f01 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d86f09c6304121be2021cb5c15e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ab544d0b547919794e3efb49ba0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:32:09.139424 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-43f38cfe-ccf1-429d-8186-27a8b51f5f01 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940" status: 200 len: 1222 microversion: 2.1 time: 0.533415 Sep 09 16:32:09.142461 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 18/34] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:32:08 2022] GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940 => generated 1222 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:32:09.156774 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-2e6b71bf-318b-4396-9656-045cacd09f18 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c0721dc18343b18993ff5af098841d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17967a941be4a04bbc180e2cf3a7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:32:09.164832 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-a85b3c84-1ea3-4fe9-8ef8-01dd7de9fb1c tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:32:09.167305 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-a85b3c84-1ea3-4fe9-8ef8-01dd7de9fb1c tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] [instance: 9e761961-9c74-444c-bb4b-0b2f82a9d698] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:32:09.177863 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-2e6b71bf-318b-4396-9656-045cacd09f18 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] 10.222.0.23 "GET /compute/v2.1/servers/c453c474-644e-4e46-9d23-b2b87716f5d7" status: 200 len: 1300 microversion: 2.1 time: 0.713832 Sep 09 16:32:09.178795 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 17/35] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:32:08 2022] GET /compute/v2.1/servers/c453c474-644e-4e46-9d23-b2b87716f5d7 => generated 1300 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:32:09.194466 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a85b3c84-1ea3-4fe9-8ef8-01dd7de9fb1c tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:09.197552 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a85b3c84-1ea3-4fe9-8ef8-01dd7de9fb1c tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:09.199587 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a85b3c84-1ea3-4fe9-8ef8-01dd7de9fb1c tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:09.201277 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a85b3c84-1ea3-4fe9-8ef8-01dd7de9fb1c tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:09.202551 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a85b3c84-1ea3-4fe9-8ef8-01dd7de9fb1c tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:09.202992 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a85b3c84-1ea3-4fe9-8ef8-01dd7de9fb1c tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:09.465952 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-7abd2d9a-f489-497d-a553-998b5f9950f6 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:32:09.466613 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-7abd2d9a-f489-497d-a553-998b5f9950f6 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] [instance: 15d68c64-0569-4afa-a718-bc0e0c2cba3e] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:32:09.475687 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-a85b3c84-1ea3-4fe9-8ef8-01dd7de9fb1c tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd095ed814b9e47e08d6b5a4fd2901c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f2e0c002343d88ae25dc7bfb2fe10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:32:09.483801 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-a85b3c84-1ea3-4fe9-8ef8-01dd7de9fb1c tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] 10.222.0.23 "GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698" status: 200 len: 1295 microversion: 2.1 time: 0.339872 Sep 09 16:32:09.484419 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 19/36] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:32:09 2022] GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698 => generated 1295 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:32:09.517830 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-7abd2d9a-f489-497d-a553-998b5f9950f6 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:09.518356 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-7abd2d9a-f489-497d-a553-998b5f9950f6 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:09.521632 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-7abd2d9a-f489-497d-a553-998b5f9950f6 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:09.522401 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-7abd2d9a-f489-497d-a553-998b5f9950f6 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:09.532310 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-7abd2d9a-f489-497d-a553-998b5f9950f6 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:09.533030 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-7abd2d9a-f489-497d-a553-998b5f9950f6 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:09.836812 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-7abd2d9a-f489-497d-a553-998b5f9950f6 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce1cd9c19584549b794df8e487abf00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f227ee89ce84dec84410a1db9b479fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:32:09.853951 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-7abd2d9a-f489-497d-a553-998b5f9950f6 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] 10.222.0.23 "GET /compute/v2.1/servers/15d68c64-0569-4afa-a718-bc0e0c2cba3e" status: 200 len: 1271 microversion: 2.1 time: 0.392095 Sep 09 16:32:09.859532 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 18/37] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:32:09 2022] GET /compute/v2.1/servers/15d68c64-0569-4afa-a718-bc0e0c2cba3e => generated 1271 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 16:32:10.172124 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-8d5938c9-8770-40bb-a408-6de68a1995fd tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:32:10.173511 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-8d5938c9-8770-40bb-a408-6de68a1995fd tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: e8d23cb3-2f39-4b00-ae9d-006e392a5940] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:32:10.208452 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-0dafff53-6336-47dc-bdff-d3a3508c29a3 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:32:10.211194 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-0dafff53-6336-47dc-bdff-d3a3508c29a3 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] [instance: c453c474-644e-4e46-9d23-b2b87716f5d7] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:32:10.224620 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8d5938c9-8770-40bb-a408-6de68a1995fd tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:10.225514 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8d5938c9-8770-40bb-a408-6de68a1995fd tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:10.227743 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8d5938c9-8770-40bb-a408-6de68a1995fd tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:10.231603 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-0dafff53-6336-47dc-bdff-d3a3508c29a3 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:10.235190 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-0dafff53-6336-47dc-bdff-d3a3508c29a3 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:10.235819 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8d5938c9-8770-40bb-a408-6de68a1995fd tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:10.237658 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8d5938c9-8770-40bb-a408-6de68a1995fd tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:10.238031 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-0dafff53-6336-47dc-bdff-d3a3508c29a3 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:10.238662 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8d5938c9-8770-40bb-a408-6de68a1995fd tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:10.243775 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-0dafff53-6336-47dc-bdff-d3a3508c29a3 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:10.244471 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-0dafff53-6336-47dc-bdff-d3a3508c29a3 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:10.246486 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-0dafff53-6336-47dc-bdff-d3a3508c29a3 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:10.870435 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-0dafff53-6336-47dc-bdff-d3a3508c29a3 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c0721dc18343b18993ff5af098841d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17967a941be4a04bbc180e2cf3a7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:32:10.884896 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-0dafff53-6336-47dc-bdff-d3a3508c29a3 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] 10.222.0.23 "GET /compute/v2.1/servers/c453c474-644e-4e46-9d23-b2b87716f5d7" status: 200 len: 1298 microversion: 2.1 time: 0.683270 Sep 09 16:32:10.900011 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 19/38] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:32:10 2022] GET /compute/v2.1/servers/c453c474-644e-4e46-9d23-b2b87716f5d7 => generated 1298 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 16:32:10.917815 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-3973ccd2-bd66-4427-92a2-f4c4de16b029 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:32:10.918468 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-3973ccd2-bd66-4427-92a2-f4c4de16b029 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] [instance: 9e761961-9c74-444c-bb4b-0b2f82a9d698] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:32:10.931762 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-3973ccd2-bd66-4427-92a2-f4c4de16b029 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:10.936542 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-8d5938c9-8770-40bb-a408-6de68a1995fd tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d86f09c6304121be2021cb5c15e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ab544d0b547919794e3efb49ba0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:32:10.937681 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-3973ccd2-bd66-4427-92a2-f4c4de16b029 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:10.938214 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-3973ccd2-bd66-4427-92a2-f4c4de16b029 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:10.940626 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-3973ccd2-bd66-4427-92a2-f4c4de16b029 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:10.941153 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-3973ccd2-bd66-4427-92a2-f4c4de16b029 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:10.941589 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-3973ccd2-bd66-4427-92a2-f4c4de16b029 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:10.952111 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-8d5938c9-8770-40bb-a408-6de68a1995fd tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940" status: 200 len: 1226 microversion: 2.1 time: 0.787305 Sep 09 16:32:10.962991 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 20/39] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:32:10 2022] GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940 => generated 1226 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:32:10.985796 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-c353e84c-6707-414c-b50d-bcbc4121a2e8 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:32:10.986439 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-c353e84c-6707-414c-b50d-bcbc4121a2e8 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] [instance: 15d68c64-0569-4afa-a718-bc0e0c2cba3e] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:32:11.026689 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c353e84c-6707-414c-b50d-bcbc4121a2e8 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:11.034952 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c353e84c-6707-414c-b50d-bcbc4121a2e8 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:11.043815 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c353e84c-6707-414c-b50d-bcbc4121a2e8 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:11.048171 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c353e84c-6707-414c-b50d-bcbc4121a2e8 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:11.054098 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c353e84c-6707-414c-b50d-bcbc4121a2e8 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:11.057743 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c353e84c-6707-414c-b50d-bcbc4121a2e8 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:11.448497 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-c353e84c-6707-414c-b50d-bcbc4121a2e8 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce1cd9c19584549b794df8e487abf00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f227ee89ce84dec84410a1db9b479fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:32:11.469136 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-c353e84c-6707-414c-b50d-bcbc4121a2e8 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] 10.222.0.23 "GET /compute/v2.1/servers/15d68c64-0569-4afa-a718-bc0e0c2cba3e" status: 200 len: 1271 microversion: 2.1 time: 0.502210 Sep 09 16:32:11.472800 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 21/40] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:32:10 2022] GET /compute/v2.1/servers/15d68c64-0569-4afa-a718-bc0e0c2cba3e => generated 1271 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:32:11.534414 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-3973ccd2-bd66-4427-92a2-f4c4de16b029 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd095ed814b9e47e08d6b5a4fd2901c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f2e0c002343d88ae25dc7bfb2fe10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:32:11.542302 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-3973ccd2-bd66-4427-92a2-f4c4de16b029 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] 10.222.0.23 "GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698" status: 200 len: 1362 microversion: 2.1 time: 0.641101 Sep 09 16:32:11.546604 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 20/41] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:32:10 2022] GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698 => generated 1362 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:32:11.923759 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-2d311aed-85c9-40d0-8d3a-31eb071714c3 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:32:11.924889 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-2d311aed-85c9-40d0-8d3a-31eb071714c3 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] [instance: c453c474-644e-4e46-9d23-b2b87716f5d7] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:32:11.937438 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2d311aed-85c9-40d0-8d3a-31eb071714c3 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:11.946432 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2d311aed-85c9-40d0-8d3a-31eb071714c3 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:11.948349 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2d311aed-85c9-40d0-8d3a-31eb071714c3 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:11.950593 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2d311aed-85c9-40d0-8d3a-31eb071714c3 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:11.952170 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2d311aed-85c9-40d0-8d3a-31eb071714c3 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:11.953832 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2d311aed-85c9-40d0-8d3a-31eb071714c3 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:11.979024 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-2e674ddf-7f10-4f0a-9047-b6321787ad63 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:32:11.979575 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-2e674ddf-7f10-4f0a-9047-b6321787ad63 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: e8d23cb3-2f39-4b00-ae9d-006e392a5940] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:32:11.994288 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-2e674ddf-7f10-4f0a-9047-b6321787ad63 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:11.995154 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-2e674ddf-7f10-4f0a-9047-b6321787ad63 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:11.995836 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-2e674ddf-7f10-4f0a-9047-b6321787ad63 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:11.996762 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-2e674ddf-7f10-4f0a-9047-b6321787ad63 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:11.997446 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-2e674ddf-7f10-4f0a-9047-b6321787ad63 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:11.999762 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-2e674ddf-7f10-4f0a-9047-b6321787ad63 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:12.157954 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-2e674ddf-7f10-4f0a-9047-b6321787ad63 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d86f09c6304121be2021cb5c15e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ab544d0b547919794e3efb49ba0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:32:12.166810 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-2e674ddf-7f10-4f0a-9047-b6321787ad63 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940" status: 200 len: 1226 microversion: 2.1 time: 0.191782 Sep 09 16:32:12.175717 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 21/42] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:32:11 2022] GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940 => generated 1226 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 16:32:12.206050 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-2d311aed-85c9-40d0-8d3a-31eb071714c3 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c0721dc18343b18993ff5af098841d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17967a941be4a04bbc180e2cf3a7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:32:12.265827 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-2d311aed-85c9-40d0-8d3a-31eb071714c3 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] 10.222.0.23 "GET /compute/v2.1/servers/c453c474-644e-4e46-9d23-b2b87716f5d7" status: 200 len: 1298 microversion: 2.1 time: 0.354433 Sep 09 16:32:12.268905 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 22/43] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:32:11 2022] GET /compute/v2.1/servers/c453c474-644e-4e46-9d23-b2b87716f5d7 => generated 1298 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:32:12.498224 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-59c263af-ed63-4346-b17d-cee6c4907c7a tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:32:12.498920 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-59c263af-ed63-4346-b17d-cee6c4907c7a tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] [instance: 15d68c64-0569-4afa-a718-bc0e0c2cba3e] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:32:12.510173 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-59c263af-ed63-4346-b17d-cee6c4907c7a tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:12.510732 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-59c263af-ed63-4346-b17d-cee6c4907c7a tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:12.512016 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-59c263af-ed63-4346-b17d-cee6c4907c7a tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:12.513844 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-59c263af-ed63-4346-b17d-cee6c4907c7a tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:12.516939 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-59c263af-ed63-4346-b17d-cee6c4907c7a tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:12.518556 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-59c263af-ed63-4346-b17d-cee6c4907c7a tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:12.573620 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-0948a857-ac66-4456-83dc-28b7edd959a7 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:32:12.574528 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-0948a857-ac66-4456-83dc-28b7edd959a7 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] [instance: 9e761961-9c74-444c-bb4b-0b2f82a9d698] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:32:12.584852 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0948a857-ac66-4456-83dc-28b7edd959a7 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:12.585677 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0948a857-ac66-4456-83dc-28b7edd959a7 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:12.588000 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0948a857-ac66-4456-83dc-28b7edd959a7 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:12.591057 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0948a857-ac66-4456-83dc-28b7edd959a7 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:12.592837 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0948a857-ac66-4456-83dc-28b7edd959a7 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:12.593623 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0948a857-ac66-4456-83dc-28b7edd959a7 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:13.127591 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-59c263af-ed63-4346-b17d-cee6c4907c7a tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce1cd9c19584549b794df8e487abf00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f227ee89ce84dec84410a1db9b479fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:32:13.139239 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-59c263af-ed63-4346-b17d-cee6c4907c7a tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] 10.222.0.23 "GET /compute/v2.1/servers/15d68c64-0569-4afa-a718-bc0e0c2cba3e" status: 200 len: 1313 microversion: 2.1 time: 0.645751 Sep 09 16:32:13.140412 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 22/44] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:32:12 2022] GET /compute/v2.1/servers/15d68c64-0569-4afa-a718-bc0e0c2cba3e => generated 1313 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:32:13.163083 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-0948a857-ac66-4456-83dc-28b7edd959a7 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd095ed814b9e47e08d6b5a4fd2901c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f2e0c002343d88ae25dc7bfb2fe10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:32:13.172324 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-0948a857-ac66-4456-83dc-28b7edd959a7 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] 10.222.0.23 "GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698" status: 200 len: 1362 microversion: 2.1 time: 0.604116 Sep 09 16:32:13.172901 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 23/45] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:32:12 2022] GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698 => generated 1362 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 16:32:13.197671 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-33517171-6ca9-4cde-ab8e-1db3150ee12b tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:32:13.198433 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-33517171-6ca9-4cde-ab8e-1db3150ee12b tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: e8d23cb3-2f39-4b00-ae9d-006e392a5940] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:32:13.205065 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-33517171-6ca9-4cde-ab8e-1db3150ee12b tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:13.205552 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-33517171-6ca9-4cde-ab8e-1db3150ee12b tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:13.205982 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-33517171-6ca9-4cde-ab8e-1db3150ee12b tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:13.206950 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-33517171-6ca9-4cde-ab8e-1db3150ee12b tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:13.210718 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-33517171-6ca9-4cde-ab8e-1db3150ee12b tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:13.211214 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-33517171-6ca9-4cde-ab8e-1db3150ee12b tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:13.283123 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-33517171-6ca9-4cde-ab8e-1db3150ee12b tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d86f09c6304121be2021cb5c15e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ab544d0b547919794e3efb49ba0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:32:13.291530 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-33517171-6ca9-4cde-ab8e-1db3150ee12b tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940" status: 200 len: 1226 microversion: 2.1 time: 0.098122 Sep 09 16:32:13.292899 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 23/46] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:32:13 2022] GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940 => generated 1226 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:32:13.294854 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-0e912a5a-147a-49d6-81a9-d78a2806438f tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:32:13.295627 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-0e912a5a-147a-49d6-81a9-d78a2806438f tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] [instance: c453c474-644e-4e46-9d23-b2b87716f5d7] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:32:13.302580 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0e912a5a-147a-49d6-81a9-d78a2806438f tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:13.304517 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0e912a5a-147a-49d6-81a9-d78a2806438f tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:13.305733 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0e912a5a-147a-49d6-81a9-d78a2806438f tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:13.306443 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0e912a5a-147a-49d6-81a9-d78a2806438f tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:13.307068 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0e912a5a-147a-49d6-81a9-d78a2806438f tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:13.307634 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0e912a5a-147a-49d6-81a9-d78a2806438f tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:13.394143 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-0e912a5a-147a-49d6-81a9-d78a2806438f tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c0721dc18343b18993ff5af098841d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17967a941be4a04bbc180e2cf3a7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:32:13.409009 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-0e912a5a-147a-49d6-81a9-d78a2806438f tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] 10.222.0.23 "GET /compute/v2.1/servers/c453c474-644e-4e46-9d23-b2b87716f5d7" status: 200 len: 1298 microversion: 2.1 time: 0.118104 Sep 09 16:32:13.409978 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 24/47] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:32:13 2022] GET /compute/v2.1/servers/c453c474-644e-4e46-9d23-b2b87716f5d7 => generated 1298 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 16:32:14.162757 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-94757744-758a-4c13-bb72-c8fda2fc882f tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:32:14.164410 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-94757744-758a-4c13-bb72-c8fda2fc882f tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] [instance: 15d68c64-0569-4afa-a718-bc0e0c2cba3e] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:32:14.170701 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-94757744-758a-4c13-bb72-c8fda2fc882f tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:14.171179 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-94757744-758a-4c13-bb72-c8fda2fc882f tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:14.171612 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-94757744-758a-4c13-bb72-c8fda2fc882f tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:14.172306 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-94757744-758a-4c13-bb72-c8fda2fc882f tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:14.172757 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-94757744-758a-4c13-bb72-c8fda2fc882f tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:14.173337 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-94757744-758a-4c13-bb72-c8fda2fc882f tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:14.195148 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-f2f9f77c-85c4-4b43-90c8-1990e90e57d6 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:32:14.196510 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-f2f9f77c-85c4-4b43-90c8-1990e90e57d6 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] [instance: 9e761961-9c74-444c-bb4b-0b2f82a9d698] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:32:14.204171 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f2f9f77c-85c4-4b43-90c8-1990e90e57d6 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:14.204662 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f2f9f77c-85c4-4b43-90c8-1990e90e57d6 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:14.205096 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f2f9f77c-85c4-4b43-90c8-1990e90e57d6 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:14.205952 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f2f9f77c-85c4-4b43-90c8-1990e90e57d6 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:14.206404 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f2f9f77c-85c4-4b43-90c8-1990e90e57d6 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:14.206911 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f2f9f77c-85c4-4b43-90c8-1990e90e57d6 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:14.380022 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-94757744-758a-4c13-bb72-c8fda2fc882f tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce1cd9c19584549b794df8e487abf00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f227ee89ce84dec84410a1db9b479fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:32:14.385846 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-f2f9f77c-85c4-4b43-90c8-1990e90e57d6 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd095ed814b9e47e08d6b5a4fd2901c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f2e0c002343d88ae25dc7bfb2fe10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:32:14.388538 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-94757744-758a-4c13-bb72-c8fda2fc882f tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] 10.222.0.23 "GET /compute/v2.1/servers/15d68c64-0569-4afa-a718-bc0e0c2cba3e" status: 200 len: 1313 microversion: 2.1 time: 0.229797 Sep 09 16:32:14.389298 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 24/48] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:32:14 2022] GET /compute/v2.1/servers/15d68c64-0569-4afa-a718-bc0e0c2cba3e => generated 1313 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:32:14.394289 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-58c043aa-293a-4c27-8b67-5ee9e064650c tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:32:14.394920 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-58c043aa-293a-4c27-8b67-5ee9e064650c tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: e8d23cb3-2f39-4b00-ae9d-006e392a5940] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:32:14.400589 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-58c043aa-293a-4c27-8b67-5ee9e064650c tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:14.401061 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-58c043aa-293a-4c27-8b67-5ee9e064650c tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:14.401487 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-58c043aa-293a-4c27-8b67-5ee9e064650c tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:14.402199 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-58c043aa-293a-4c27-8b67-5ee9e064650c tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:14.402783 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-58c043aa-293a-4c27-8b67-5ee9e064650c tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:14.403205 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-58c043aa-293a-4c27-8b67-5ee9e064650c tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:14.407506 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-f2f9f77c-85c4-4b43-90c8-1990e90e57d6 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] 10.222.0.23 "GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698" status: 200 len: 1362 microversion: 2.1 time: 0.216272 Sep 09 16:32:14.408093 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 25/49] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:32:14 2022] GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698 => generated 1362 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 16:32:14.433087 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-86e62ea4-da50-4b86-8374-b1b2a3bb742c tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:32:14.434017 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-86e62ea4-da50-4b86-8374-b1b2a3bb742c tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] [instance: c453c474-644e-4e46-9d23-b2b87716f5d7] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:32:14.440535 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-86e62ea4-da50-4b86-8374-b1b2a3bb742c tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:14.441346 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-86e62ea4-da50-4b86-8374-b1b2a3bb742c tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:14.441828 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-86e62ea4-da50-4b86-8374-b1b2a3bb742c tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:14.442718 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-86e62ea4-da50-4b86-8374-b1b2a3bb742c tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:14.443433 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-86e62ea4-da50-4b86-8374-b1b2a3bb742c tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:14.443930 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-86e62ea4-da50-4b86-8374-b1b2a3bb742c tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:14.468058 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-58c043aa-293a-4c27-8b67-5ee9e064650c tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d86f09c6304121be2021cb5c15e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ab544d0b547919794e3efb49ba0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:32:14.477489 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-58c043aa-293a-4c27-8b67-5ee9e064650c tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940" status: 200 len: 1226 microversion: 2.1 time: 0.086782 Sep 09 16:32:14.478177 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 25/50] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:32:14 2022] GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940 => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:32:14.512463 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-86e62ea4-da50-4b86-8374-b1b2a3bb742c tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c0721dc18343b18993ff5af098841d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17967a941be4a04bbc180e2cf3a7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:32:14.520538 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-86e62ea4-da50-4b86-8374-b1b2a3bb742c tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] 10.222.0.23 "GET /compute/v2.1/servers/c453c474-644e-4e46-9d23-b2b87716f5d7" status: 200 len: 1298 microversion: 2.1 time: 0.091771 Sep 09 16:32:14.521022 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 26/51] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:32:14 2022] GET /compute/v2.1/servers/c453c474-644e-4e46-9d23-b2b87716f5d7 => generated 1298 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 16:32:15.413349 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-eeda979f-8db9-4906-af07-43980b3c32fd tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:32:15.413965 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-eeda979f-8db9-4906-af07-43980b3c32fd tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] [instance: 15d68c64-0569-4afa-a718-bc0e0c2cba3e] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:32:15.417203 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG dbcounter [-] [127196] Writing DB stats nova_cell0:SELECT=6 {{(pid=127196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:32:15.425879 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-eeda979f-8db9-4906-af07-43980b3c32fd tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:15.427494 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-eeda979f-8db9-4906-af07-43980b3c32fd tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:15.429454 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-eeda979f-8db9-4906-af07-43980b3c32fd tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:15.430445 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-eeda979f-8db9-4906-af07-43980b3c32fd tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:15.431097 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-eeda979f-8db9-4906-af07-43980b3c32fd tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:15.431684 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-eeda979f-8db9-4906-af07-43980b3c32fd tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:15.436532 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-ef29133b-e748-4e1d-878f-d6f53babad0d tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:32:15.437123 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-ef29133b-e748-4e1d-878f-d6f53babad0d tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] [instance: 9e761961-9c74-444c-bb4b-0b2f82a9d698] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:32:15.455639 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ef29133b-e748-4e1d-878f-d6f53babad0d tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:15.456137 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ef29133b-e748-4e1d-878f-d6f53babad0d tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:15.456642 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ef29133b-e748-4e1d-878f-d6f53babad0d tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:15.457491 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ef29133b-e748-4e1d-878f-d6f53babad0d tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:15.458021 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ef29133b-e748-4e1d-878f-d6f53babad0d tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:15.458486 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ef29133b-e748-4e1d-878f-d6f53babad0d tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:15.466811 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG dbcounter [-] [127196] Writing DB stats nova_cell0:SELECT=20 {{(pid=127196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:32:15.864942 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-ef29133b-e748-4e1d-878f-d6f53babad0d tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd095ed814b9e47e08d6b5a4fd2901c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f2e0c002343d88ae25dc7bfb2fe10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:32:15.866081 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-eeda979f-8db9-4906-af07-43980b3c32fd tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce1cd9c19584549b794df8e487abf00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f227ee89ce84dec84410a1db9b479fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:32:15.877052 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-eeda979f-8db9-4906-af07-43980b3c32fd tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] 10.222.0.23 "GET /compute/v2.1/servers/15d68c64-0569-4afa-a718-bc0e0c2cba3e" status: 200 len: 1313 microversion: 2.1 time: 0.466442 Sep 09 16:32:15.877649 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 26/52] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:32:15 2022] GET /compute/v2.1/servers/15d68c64-0569-4afa-a718-bc0e0c2cba3e => generated 1313 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:32:15.883447 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-ef29133b-e748-4e1d-878f-d6f53babad0d tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] 10.222.0.23 "GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698" status: 200 len: 1362 microversion: 2.1 time: 0.450879 Sep 09 16:32:15.893911 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-2effdec9-f41a-4924-b8c8-b6d5a7a16151 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:32:15.894461 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-2effdec9-f41a-4924-b8c8-b6d5a7a16151 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: e8d23cb3-2f39-4b00-ae9d-006e392a5940] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:32:15.900422 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 27/53] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:32:15 2022] GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698 => generated 1362 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:32:15.905846 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-2effdec9-f41a-4924-b8c8-b6d5a7a16151 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:15.907870 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-2effdec9-f41a-4924-b8c8-b6d5a7a16151 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:15.908638 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-2effdec9-f41a-4924-b8c8-b6d5a7a16151 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:15.909493 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-2effdec9-f41a-4924-b8c8-b6d5a7a16151 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:15.911367 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-2effdec9-f41a-4924-b8c8-b6d5a7a16151 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:15.911728 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-81d3299d-dab0-456e-92f1-c7dd86d3e58d tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:32:15.912321 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-2effdec9-f41a-4924-b8c8-b6d5a7a16151 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:15.914647 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-81d3299d-dab0-456e-92f1-c7dd86d3e58d tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] [instance: c453c474-644e-4e46-9d23-b2b87716f5d7] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:32:15.930864 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-81d3299d-dab0-456e-92f1-c7dd86d3e58d tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:15.931426 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-81d3299d-dab0-456e-92f1-c7dd86d3e58d tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:15.931930 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-81d3299d-dab0-456e-92f1-c7dd86d3e58d tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:15.932947 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-81d3299d-dab0-456e-92f1-c7dd86d3e58d tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:15.938133 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-81d3299d-dab0-456e-92f1-c7dd86d3e58d tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:15.939907 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-81d3299d-dab0-456e-92f1-c7dd86d3e58d tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:16.022907 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-2effdec9-f41a-4924-b8c8-b6d5a7a16151 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d86f09c6304121be2021cb5c15e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ab544d0b547919794e3efb49ba0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:32:16.033317 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-2effdec9-f41a-4924-b8c8-b6d5a7a16151 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940" status: 200 len: 1218 microversion: 2.1 time: 0.154238 Sep 09 16:32:16.033911 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 27/54] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:32:15 2022] GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940 => generated 1218 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:32:16.055738 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-81d3299d-dab0-456e-92f1-c7dd86d3e58d tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c0721dc18343b18993ff5af098841d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17967a941be4a04bbc180e2cf3a7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:32:16.075724 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-81d3299d-dab0-456e-92f1-c7dd86d3e58d tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] 10.222.0.23 "GET /compute/v2.1/servers/c453c474-644e-4e46-9d23-b2b87716f5d7" status: 200 len: 1298 microversion: 2.1 time: 0.169441 Sep 09 16:32:16.091342 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 28/55] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:32:15 2022] GET /compute/v2.1/servers/c453c474-644e-4e46-9d23-b2b87716f5d7 => generated 1298 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:32:16.908539 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-bb62396c-6e3c-4e98-afc7-045f774751b8 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:32:16.912046 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-bb62396c-6e3c-4e98-afc7-045f774751b8 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] [instance: 15d68c64-0569-4afa-a718-bc0e0c2cba3e] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:32:16.915975 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-0bc691c8-1a2d-4f59-bfa2-0a96ebb61c6c tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:32:16.917290 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-0bc691c8-1a2d-4f59-bfa2-0a96ebb61c6c tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] [instance: 9e761961-9c74-444c-bb4b-0b2f82a9d698] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:32:16.928071 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-bb62396c-6e3c-4e98-afc7-045f774751b8 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:16.929486 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-bb62396c-6e3c-4e98-afc7-045f774751b8 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:16.930376 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-bb62396c-6e3c-4e98-afc7-045f774751b8 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:16.931348 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0bc691c8-1a2d-4f59-bfa2-0a96ebb61c6c tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:16.931493 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-bb62396c-6e3c-4e98-afc7-045f774751b8 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:16.932063 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-bb62396c-6e3c-4e98-afc7-045f774751b8 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:16.932459 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0bc691c8-1a2d-4f59-bfa2-0a96ebb61c6c tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:16.933179 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0bc691c8-1a2d-4f59-bfa2-0a96ebb61c6c tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:16.933375 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-bb62396c-6e3c-4e98-afc7-045f774751b8 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:16.934226 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0bc691c8-1a2d-4f59-bfa2-0a96ebb61c6c tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:16.934912 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0bc691c8-1a2d-4f59-bfa2-0a96ebb61c6c tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:16.935776 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0bc691c8-1a2d-4f59-bfa2-0a96ebb61c6c tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:17.340075 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-0bc691c8-1a2d-4f59-bfa2-0a96ebb61c6c tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd095ed814b9e47e08d6b5a4fd2901c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f2e0c002343d88ae25dc7bfb2fe10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:32:17.355944 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-0bc691c8-1a2d-4f59-bfa2-0a96ebb61c6c tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] 10.222.0.23 "GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698" status: 200 len: 1362 microversion: 2.1 time: 0.445632 Sep 09 16:32:17.357943 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 29/56] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:32:16 2022] GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698 => generated 1362 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:32:17.366170 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-3ae0285c-a667-4711-ae6b-0320525ece79 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:32:17.367070 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-3ae0285c-a667-4711-ae6b-0320525ece79 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: e8d23cb3-2f39-4b00-ae9d-006e392a5940] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:32:17.371316 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-bb62396c-6e3c-4e98-afc7-045f774751b8 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce1cd9c19584549b794df8e487abf00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f227ee89ce84dec84410a1db9b479fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:32:17.379019 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3ae0285c-a667-4711-ae6b-0320525ece79 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:17.379832 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3ae0285c-a667-4711-ae6b-0320525ece79 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:17.380979 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3ae0285c-a667-4711-ae6b-0320525ece79 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:17.382956 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3ae0285c-a667-4711-ae6b-0320525ece79 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:17.384489 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3ae0285c-a667-4711-ae6b-0320525ece79 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:17.385128 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3ae0285c-a667-4711-ae6b-0320525ece79 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:17.396594 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-bb62396c-6e3c-4e98-afc7-045f774751b8 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] 10.222.0.23 "GET /compute/v2.1/servers/15d68c64-0569-4afa-a718-bc0e0c2cba3e" status: 200 len: 1313 microversion: 2.1 time: 0.493591 Sep 09 16:32:17.399226 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 28/57] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:32:16 2022] GET /compute/v2.1/servers/15d68c64-0569-4afa-a718-bc0e0c2cba3e => generated 1313 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:32:17.413217 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-f6714d1f-1fab-431c-82ef-5c67393ce182 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:32:17.414919 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-f6714d1f-1fab-431c-82ef-5c67393ce182 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] [instance: c453c474-644e-4e46-9d23-b2b87716f5d7] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:32:17.427462 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f6714d1f-1fab-431c-82ef-5c67393ce182 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:17.428194 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f6714d1f-1fab-431c-82ef-5c67393ce182 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:17.429413 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f6714d1f-1fab-431c-82ef-5c67393ce182 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:17.430318 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f6714d1f-1fab-431c-82ef-5c67393ce182 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:17.430942 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f6714d1f-1fab-431c-82ef-5c67393ce182 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:17.431563 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f6714d1f-1fab-431c-82ef-5c67393ce182 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:17.462801 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG dbcounter [-] [127196] Writing DB stats nova_cell1:SELECT=100 {{(pid=127196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:32:17.523785 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-3ae0285c-a667-4711-ae6b-0320525ece79 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d86f09c6304121be2021cb5c15e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ab544d0b547919794e3efb49ba0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:32:17.536937 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-3ae0285c-a667-4711-ae6b-0320525ece79 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940" status: 200 len: 1218 microversion: 2.1 time: 0.177523 Sep 09 16:32:17.540958 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 30/58] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:32:17 2022] GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940 => generated 1218 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:32:17.554788 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-f6714d1f-1fab-431c-82ef-5c67393ce182 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c0721dc18343b18993ff5af098841d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17967a941be4a04bbc180e2cf3a7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:32:17.576142 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-f6714d1f-1fab-431c-82ef-5c67393ce182 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] 10.222.0.23 "GET /compute/v2.1/servers/c453c474-644e-4e46-9d23-b2b87716f5d7" status: 200 len: 1298 microversion: 2.1 time: 0.175442 Sep 09 16:32:17.589460 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 29/59] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:32:17 2022] GET /compute/v2.1/servers/c453c474-644e-4e46-9d23-b2b87716f5d7 => generated 1298 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:32:18.381637 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell0:SELECT=4 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:32:18.386755 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-26b47298-b1c3-4ceb-9a41-5bd685feb243 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:32:18.389007 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-26b47298-b1c3-4ceb-9a41-5bd685feb243 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] [instance: 9e761961-9c74-444c-bb4b-0b2f82a9d698] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:32:18.421962 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-26b47298-b1c3-4ceb-9a41-5bd685feb243 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:18.426286 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-0e0ad26c-5aa1-40be-8d6b-0582ce642ca6 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:32:18.430438 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-0e0ad26c-5aa1-40be-8d6b-0582ce642ca6 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] [instance: 15d68c64-0569-4afa-a718-bc0e0c2cba3e] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:32:18.435037 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-26b47298-b1c3-4ceb-9a41-5bd685feb243 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:18.435539 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-26b47298-b1c3-4ceb-9a41-5bd685feb243 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:18.436294 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-26b47298-b1c3-4ceb-9a41-5bd685feb243 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:18.436752 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-26b47298-b1c3-4ceb-9a41-5bd685feb243 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:18.440643 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-0e0ad26c-5aa1-40be-8d6b-0582ce642ca6 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:18.442336 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-26b47298-b1c3-4ceb-9a41-5bd685feb243 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:18.445979 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-0e0ad26c-5aa1-40be-8d6b-0582ce642ca6 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:18.447138 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-0e0ad26c-5aa1-40be-8d6b-0582ce642ca6 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:18.449303 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-0e0ad26c-5aa1-40be-8d6b-0582ce642ca6 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:18.450465 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-0e0ad26c-5aa1-40be-8d6b-0582ce642ca6 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:18.452871 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-0e0ad26c-5aa1-40be-8d6b-0582ce642ca6 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:18.878243 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-0e0ad26c-5aa1-40be-8d6b-0582ce642ca6 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce1cd9c19584549b794df8e487abf00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f227ee89ce84dec84410a1db9b479fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:32:18.886375 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-0e0ad26c-5aa1-40be-8d6b-0582ce642ca6 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] 10.222.0.23 "GET /compute/v2.1/servers/15d68c64-0569-4afa-a718-bc0e0c2cba3e" status: 200 len: 1313 microversion: 2.1 time: 0.464935 Sep 09 16:32:18.887242 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 30/60] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:32:18 2022] GET /compute/v2.1/servers/15d68c64-0569-4afa-a718-bc0e0c2cba3e => generated 1313 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 16:32:18.903698 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-26b47298-b1c3-4ceb-9a41-5bd685feb243 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd095ed814b9e47e08d6b5a4fd2901c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f2e0c002343d88ae25dc7bfb2fe10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:32:18.918239 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-5f5287cc-589c-4ea2-9c11-a753fa3c1b1c tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:32:18.919553 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-5f5287cc-589c-4ea2-9c11-a753fa3c1b1c tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: e8d23cb3-2f39-4b00-ae9d-006e392a5940] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:32:18.920084 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-26b47298-b1c3-4ceb-9a41-5bd685feb243 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] 10.222.0.23 "GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698" status: 200 len: 1362 microversion: 2.1 time: 0.539095 Sep 09 16:32:18.922205 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 31/61] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:32:18 2022] GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698 => generated 1362 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:32:18.927958 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-5f5287cc-589c-4ea2-9c11-a753fa3c1b1c tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:18.928766 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-5f5287cc-589c-4ea2-9c11-a753fa3c1b1c tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:18.929379 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-5f5287cc-589c-4ea2-9c11-a753fa3c1b1c tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:18.930232 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-5f5287cc-589c-4ea2-9c11-a753fa3c1b1c tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:18.930977 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-5f5287cc-589c-4ea2-9c11-a753fa3c1b1c tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:18.932115 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-5f5287cc-589c-4ea2-9c11-a753fa3c1b1c tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:18.932807 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-7c7190df-d152-4bc3-8dac-6426efd2a1dc tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:32:18.933999 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-7c7190df-d152-4bc3-8dac-6426efd2a1dc tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] [instance: c453c474-644e-4e46-9d23-b2b87716f5d7] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:32:18.946329 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7c7190df-d152-4bc3-8dac-6426efd2a1dc tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:18.946979 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7c7190df-d152-4bc3-8dac-6426efd2a1dc tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:18.947478 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7c7190df-d152-4bc3-8dac-6426efd2a1dc tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:18.950596 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7c7190df-d152-4bc3-8dac-6426efd2a1dc tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:18.951358 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7c7190df-d152-4bc3-8dac-6426efd2a1dc tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:18.953336 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7c7190df-d152-4bc3-8dac-6426efd2a1dc tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:19.050603 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-5f5287cc-589c-4ea2-9c11-a753fa3c1b1c tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d86f09c6304121be2021cb5c15e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ab544d0b547919794e3efb49ba0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:32:19.061445 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-5f5287cc-589c-4ea2-9c11-a753fa3c1b1c tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940" status: 200 len: 1274 microversion: 2.1 time: 0.149990 Sep 09 16:32:19.062365 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 31/62] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:32:18 2022] GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940 => generated 1274 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:32:19.135656 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell0:SELECT=26 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:32:19.259779 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-7c7190df-d152-4bc3-8dac-6426efd2a1dc tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c0721dc18343b18993ff5af098841d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17967a941be4a04bbc180e2cf3a7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:32:19.272970 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-7c7190df-d152-4bc3-8dac-6426efd2a1dc tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] 10.222.0.23 "GET /compute/v2.1/servers/c453c474-644e-4e46-9d23-b2b87716f5d7" status: 200 len: 1366 microversion: 2.1 time: 0.349476 Sep 09 16:32:19.273835 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 32/63] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:32:18 2022] GET /compute/v2.1/servers/c453c474-644e-4e46-9d23-b2b87716f5d7 => generated 1366 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:32:19.910860 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-9161179b-9b10-458b-8bb6-718ae41282f8 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:32:19.912482 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-9161179b-9b10-458b-8bb6-718ae41282f8 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] [instance: 15d68c64-0569-4afa-a718-bc0e0c2cba3e] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:32:19.925054 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-9161179b-9b10-458b-8bb6-718ae41282f8 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:19.925793 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-9161179b-9b10-458b-8bb6-718ae41282f8 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:19.926635 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-9161179b-9b10-458b-8bb6-718ae41282f8 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:19.927467 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-9161179b-9b10-458b-8bb6-718ae41282f8 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:19.927927 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-9161179b-9b10-458b-8bb6-718ae41282f8 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:19.928350 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-9161179b-9b10-458b-8bb6-718ae41282f8 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:19.946033 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-af001eef-acef-4b8f-939b-1d2ed741a293 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:32:19.947132 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-af001eef-acef-4b8f-939b-1d2ed741a293 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] [instance: 9e761961-9c74-444c-bb4b-0b2f82a9d698] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:32:19.954818 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:32:19.958387 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-af001eef-acef-4b8f-939b-1d2ed741a293 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:19.959382 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-af001eef-acef-4b8f-939b-1d2ed741a293 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:19.959972 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-af001eef-acef-4b8f-939b-1d2ed741a293 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:19.960832 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-af001eef-acef-4b8f-939b-1d2ed741a293 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:19.961427 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-af001eef-acef-4b8f-939b-1d2ed741a293 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:19.963896 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-af001eef-acef-4b8f-939b-1d2ed741a293 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:20.280670 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-9161179b-9b10-458b-8bb6-718ae41282f8 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce1cd9c19584549b794df8e487abf00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f227ee89ce84dec84410a1db9b479fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:32:20.303340 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-9161179b-9b10-458b-8bb6-718ae41282f8 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] 10.222.0.23 "GET /compute/v2.1/servers/15d68c64-0569-4afa-a718-bc0e0c2cba3e" status: 200 len: 1313 microversion: 2.1 time: 0.394493 Sep 09 16:32:20.308769 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-af001eef-acef-4b8f-939b-1d2ed741a293 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd095ed814b9e47e08d6b5a4fd2901c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f2e0c002343d88ae25dc7bfb2fe10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:32:20.312387 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell1:SELECT=100 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:32:20.319361 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 32/64] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:32:19 2022] GET /compute/v2.1/servers/15d68c64-0569-4afa-a718-bc0e0c2cba3e => generated 1313 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:32:20.322082 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-af001eef-acef-4b8f-939b-1d2ed741a293 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] 10.222.0.23 "GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698" status: 200 len: 1362 microversion: 2.1 time: 0.380586 Sep 09 16:32:20.326794 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 33/65] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:32:19 2022] GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698 => generated 1362 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:32:20.330660 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-696957d4-eb16-4166-9e3d-5152d4115239 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:32:20.331529 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-696957d4-eb16-4166-9e3d-5152d4115239 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: e8d23cb3-2f39-4b00-ae9d-006e392a5940] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:32:20.338781 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-6a4d1a9c-e204-45eb-83a0-b5923ce17c3f tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:32:20.341461 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-6a4d1a9c-e204-45eb-83a0-b5923ce17c3f tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] [instance: c453c474-644e-4e46-9d23-b2b87716f5d7] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:32:20.350186 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-696957d4-eb16-4166-9e3d-5152d4115239 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:20.352009 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-696957d4-eb16-4166-9e3d-5152d4115239 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:20.354230 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-696957d4-eb16-4166-9e3d-5152d4115239 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:20.355144 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-696957d4-eb16-4166-9e3d-5152d4115239 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:20.356894 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6a4d1a9c-e204-45eb-83a0-b5923ce17c3f tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:20.357460 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-696957d4-eb16-4166-9e3d-5152d4115239 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:20.357950 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-696957d4-eb16-4166-9e3d-5152d4115239 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:20.359251 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6a4d1a9c-e204-45eb-83a0-b5923ce17c3f tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:20.360798 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6a4d1a9c-e204-45eb-83a0-b5923ce17c3f tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:20.363047 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6a4d1a9c-e204-45eb-83a0-b5923ce17c3f tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:20.363582 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6a4d1a9c-e204-45eb-83a0-b5923ce17c3f tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:20.364196 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6a4d1a9c-e204-45eb-83a0-b5923ce17c3f tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:20.540253 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-696957d4-eb16-4166-9e3d-5152d4115239 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d86f09c6304121be2021cb5c15e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ab544d0b547919794e3efb49ba0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:32:20.553237 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-696957d4-eb16-4166-9e3d-5152d4115239 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940" status: 200 len: 1274 microversion: 2.1 time: 0.228584 Sep 09 16:32:20.555407 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 33/66] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:32:20 2022] GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940 => generated 1274 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:32:20.773258 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-6a4d1a9c-e204-45eb-83a0-b5923ce17c3f tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c0721dc18343b18993ff5af098841d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17967a941be4a04bbc180e2cf3a7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:32:20.784903 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-6a4d1a9c-e204-45eb-83a0-b5923ce17c3f tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] 10.222.0.23 "GET /compute/v2.1/servers/c453c474-644e-4e46-9d23-b2b87716f5d7" status: 200 len: 1366 microversion: 2.1 time: 0.456832 Sep 09 16:32:20.785661 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 34/67] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:32:20 2022] GET /compute/v2.1/servers/c453c474-644e-4e46-9d23-b2b87716f5d7 => generated 1366 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:32:21.346290 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-a2b1ba3a-3eef-4544-8567-4675025c71f4 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:32:21.346937 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-a2b1ba3a-3eef-4544-8567-4675025c71f4 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] [instance: 15d68c64-0569-4afa-a718-bc0e0c2cba3e] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:32:21.352857 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-a2b1ba3a-3eef-4544-8567-4675025c71f4 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:21.353333 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-a2b1ba3a-3eef-4544-8567-4675025c71f4 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:21.353730 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-a2b1ba3a-3eef-4544-8567-4675025c71f4 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:21.354390 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-a2b1ba3a-3eef-4544-8567-4675025c71f4 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:21.355020 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-a2b1ba3a-3eef-4544-8567-4675025c71f4 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:21.355675 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-a2b1ba3a-3eef-4544-8567-4675025c71f4 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:21.364830 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-8ec774eb-c478-46fb-8602-886b49af1091 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:32:21.365526 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-8ec774eb-c478-46fb-8602-886b49af1091 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] [instance: 9e761961-9c74-444c-bb4b-0b2f82a9d698] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:32:21.372766 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8ec774eb-c478-46fb-8602-886b49af1091 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:21.373554 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8ec774eb-c478-46fb-8602-886b49af1091 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:21.374108 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8ec774eb-c478-46fb-8602-886b49af1091 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:21.375251 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8ec774eb-c478-46fb-8602-886b49af1091 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:21.376020 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8ec774eb-c478-46fb-8602-886b49af1091 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:21.376585 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8ec774eb-c478-46fb-8602-886b49af1091 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:21.567989 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-a2b1ba3a-3eef-4544-8567-4675025c71f4 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce1cd9c19584549b794df8e487abf00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f227ee89ce84dec84410a1db9b479fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:32:21.571832 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-8ec774eb-c478-46fb-8602-886b49af1091 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd095ed814b9e47e08d6b5a4fd2901c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f2e0c002343d88ae25dc7bfb2fe10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:32:21.576089 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-a2b1ba3a-3eef-4544-8567-4675025c71f4 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] 10.222.0.23 "GET /compute/v2.1/servers/15d68c64-0569-4afa-a718-bc0e0c2cba3e" status: 200 len: 1313 microversion: 2.1 time: 0.233551 Sep 09 16:32:21.576677 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 34/68] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:32:21 2022] GET /compute/v2.1/servers/15d68c64-0569-4afa-a718-bc0e0c2cba3e => generated 1313 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:32:21.581272 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-1c01fd8b-d707-4f86-92a5-d3bd9dbf6e4f tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:32:21.581868 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-1c01fd8b-d707-4f86-92a5-d3bd9dbf6e4f tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: e8d23cb3-2f39-4b00-ae9d-006e392a5940] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:32:21.584625 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG dbcounter [-] [127196] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=127196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:32:21.588646 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-1c01fd8b-d707-4f86-92a5-d3bd9dbf6e4f tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:21.589356 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-1c01fd8b-d707-4f86-92a5-d3bd9dbf6e4f tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:21.589526 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-8ec774eb-c478-46fb-8602-886b49af1091 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] 10.222.0.23 "GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698" status: 200 len: 1362 microversion: 2.1 time: 0.232480 Sep 09 16:32:21.590227 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-1c01fd8b-d707-4f86-92a5-d3bd9dbf6e4f tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:21.590968 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 35/69] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:32:21 2022] GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698 => generated 1362 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:32:21.606591 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-1c01fd8b-d707-4f86-92a5-d3bd9dbf6e4f tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:21.606591 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-1c01fd8b-d707-4f86-92a5-d3bd9dbf6e4f tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:21.606591 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-1c01fd8b-d707-4f86-92a5-d3bd9dbf6e4f tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:21.693872 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-1c01fd8b-d707-4f86-92a5-d3bd9dbf6e4f tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d86f09c6304121be2021cb5c15e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ab544d0b547919794e3efb49ba0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:32:21.703786 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-1c01fd8b-d707-4f86-92a5-d3bd9dbf6e4f tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940" status: 200 len: 1274 microversion: 2.1 time: 0.125671 Sep 09 16:32:21.714802 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 35/70] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:32:21 2022] GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940 => generated 1274 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:32:21.808452 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-a6625c0b-adf5-492c-94f3-c80ac5a81e03 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:32:21.809062 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-a6625c0b-adf5-492c-94f3-c80ac5a81e03 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] [instance: c453c474-644e-4e46-9d23-b2b87716f5d7] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:32:21.824060 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a6625c0b-adf5-492c-94f3-c80ac5a81e03 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:21.824554 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a6625c0b-adf5-492c-94f3-c80ac5a81e03 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:21.824985 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a6625c0b-adf5-492c-94f3-c80ac5a81e03 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:21.825680 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a6625c0b-adf5-492c-94f3-c80ac5a81e03 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:21.826200 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a6625c0b-adf5-492c-94f3-c80ac5a81e03 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:21.826551 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a6625c0b-adf5-492c-94f3-c80ac5a81e03 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:22.548809 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-a6625c0b-adf5-492c-94f3-c80ac5a81e03 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c0721dc18343b18993ff5af098841d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17967a941be4a04bbc180e2cf3a7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:32:22.562095 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-a6625c0b-adf5-492c-94f3-c80ac5a81e03 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] 10.222.0.23 "GET /compute/v2.1/servers/c453c474-644e-4e46-9d23-b2b87716f5d7" status: 200 len: 1366 microversion: 2.1 time: 0.756974 Sep 09 16:32:22.582860 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 36/71] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:32:21 2022] GET /compute/v2.1/servers/c453c474-644e-4e46-9d23-b2b87716f5d7 => generated 1366 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:32:22.604235 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-d2fa9792-bb9e-4619-a965-4e0dc4841d8b tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:32:22.605572 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-d2fa9792-bb9e-4619-a965-4e0dc4841d8b tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] [instance: 15d68c64-0569-4afa-a718-bc0e0c2cba3e] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:32:22.614829 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-d2fa9792-bb9e-4619-a965-4e0dc4841d8b tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:22.615024 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-d2fa9792-bb9e-4619-a965-4e0dc4841d8b tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:22.615870 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-d2fa9792-bb9e-4619-a965-4e0dc4841d8b tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:22.629649 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-d2fa9792-bb9e-4619-a965-4e0dc4841d8b tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:22.630609 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-9e3ec6e0-7197-4203-adde-75a5def0c5d1 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:32:22.631889 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-9e3ec6e0-7197-4203-adde-75a5def0c5d1 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] [instance: 9e761961-9c74-444c-bb4b-0b2f82a9d698] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:32:22.632642 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-d2fa9792-bb9e-4619-a965-4e0dc4841d8b tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:22.633305 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-d2fa9792-bb9e-4619-a965-4e0dc4841d8b tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:22.648418 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9e3ec6e0-7197-4203-adde-75a5def0c5d1 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:22.650419 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9e3ec6e0-7197-4203-adde-75a5def0c5d1 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:22.651775 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9e3ec6e0-7197-4203-adde-75a5def0c5d1 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:22.654274 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9e3ec6e0-7197-4203-adde-75a5def0c5d1 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:22.655666 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9e3ec6e0-7197-4203-adde-75a5def0c5d1 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:22.657984 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9e3ec6e0-7197-4203-adde-75a5def0c5d1 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:23.319270 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-d2fa9792-bb9e-4619-a965-4e0dc4841d8b tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce1cd9c19584549b794df8e487abf00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f227ee89ce84dec84410a1db9b479fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:32:23.323925 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-9e3ec6e0-7197-4203-adde-75a5def0c5d1 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd095ed814b9e47e08d6b5a4fd2901c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f2e0c002343d88ae25dc7bfb2fe10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:32:23.331521 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-9e3ec6e0-7197-4203-adde-75a5def0c5d1 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] 10.222.0.23 "GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698" status: 200 len: 1362 microversion: 2.1 time: 0.713294 Sep 09 16:32:23.333111 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-d2fa9792-bb9e-4619-a965-4e0dc4841d8b tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] 10.222.0.23 "GET /compute/v2.1/servers/15d68c64-0569-4afa-a718-bc0e0c2cba3e" status: 200 len: 1313 microversion: 2.1 time: 0.736459 Sep 09 16:32:23.334748 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 36/72] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:32:22 2022] GET /compute/v2.1/servers/15d68c64-0569-4afa-a718-bc0e0c2cba3e => generated 1313 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:32:23.346673 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 37/73] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:32:22 2022] GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698 => generated 1362 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:32:23.350774 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-69bd1fb2-2b3c-4efc-a053-7c906acb8822 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:32:23.351489 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-69bd1fb2-2b3c-4efc-a053-7c906acb8822 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: e8d23cb3-2f39-4b00-ae9d-006e392a5940] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:32:23.359088 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-69bd1fb2-2b3c-4efc-a053-7c906acb8822 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:23.359636 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-69bd1fb2-2b3c-4efc-a053-7c906acb8822 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:23.360129 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-69bd1fb2-2b3c-4efc-a053-7c906acb8822 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:23.360991 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-69bd1fb2-2b3c-4efc-a053-7c906acb8822 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:23.361588 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-69bd1fb2-2b3c-4efc-a053-7c906acb8822 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:23.362347 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-69bd1fb2-2b3c-4efc-a053-7c906acb8822 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:23.459894 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-69bd1fb2-2b3c-4efc-a053-7c906acb8822 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d86f09c6304121be2021cb5c15e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ab544d0b547919794e3efb49ba0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:32:23.469709 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-69bd1fb2-2b3c-4efc-a053-7c906acb8822 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940" status: 200 len: 1280 microversion: 2.1 time: 0.133407 Sep 09 16:32:23.470584 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 37/74] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:32:23 2022] GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940 => generated 1280 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:32:23.587264 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-4227edc8-bedd-4da6-bc0e-9cd29f8aedbb tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:32:23.588405 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-4227edc8-bedd-4da6-bc0e-9cd29f8aedbb tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] [instance: c453c474-644e-4e46-9d23-b2b87716f5d7] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:32:23.594770 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4227edc8-bedd-4da6-bc0e-9cd29f8aedbb tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:23.595543 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4227edc8-bedd-4da6-bc0e-9cd29f8aedbb tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:23.596135 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4227edc8-bedd-4da6-bc0e-9cd29f8aedbb tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:23.596969 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4227edc8-bedd-4da6-bc0e-9cd29f8aedbb tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:23.597551 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4227edc8-bedd-4da6-bc0e-9cd29f8aedbb tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:23.598101 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4227edc8-bedd-4da6-bc0e-9cd29f8aedbb tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:23.857137 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-4227edc8-bedd-4da6-bc0e-9cd29f8aedbb tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c0721dc18343b18993ff5af098841d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17967a941be4a04bbc180e2cf3a7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:32:23.867186 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-4227edc8-bedd-4da6-bc0e-9cd29f8aedbb tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] 10.222.0.23 "GET /compute/v2.1/servers/c453c474-644e-4e46-9d23-b2b87716f5d7" status: 200 len: 1366 microversion: 2.1 time: 0.283701 Sep 09 16:32:23.875708 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 38/75] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:32:23 2022] GET /compute/v2.1/servers/c453c474-644e-4e46-9d23-b2b87716f5d7 => generated 1366 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:32:24.185476 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [req-9b603b01-be50-467e-a02a-f1bca467dbef req-4a092667-8948-4a3b-b0e7-ae6c985a38ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15d68c64-0569-4afa-a718-bc0e0c2cba3e", "tag": "7a3fbdb4-6907-451e-a2ff-a2463ac94347"}]} {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:32:24.203114 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [req-9b603b01-be50-467e-a02a-f1bca467dbef req-4a092667-8948-4a3b-b0e7-ae6c985a38ad service nova] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:24.203755 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [req-9b603b01-be50-467e-a02a-f1bca467dbef req-4a092667-8948-4a3b-b0e7-ae6c985a38ad service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:24.204007 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [req-9b603b01-be50-467e-a02a-f1bca467dbef req-4a092667-8948-4a3b-b0e7-ae6c985a38ad service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:24.231262 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [req-d888f804-25fa-47b1-973a-76192ada5937 req-e8a65ff7-c463-4cef-8d58-c86422974864 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e761961-9c74-444c-bb4b-0b2f82a9d698", "tag": "a26fe3a3-c8fd-45e4-8105-8c34395addd8"}]} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:32:24.241493 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.compute.server_external_events [req-9b603b01-be50-467e-a02a-f1bca467dbef req-4a092667-8948-4a3b-b0e7-ae6c985a38ad service nova] Creating event network-changed:7a3fbdb4-6907-451e-a2ff-a2463ac94347 for instance 15d68c64-0569-4afa-a718-bc0e0c2cba3e on hv-cinder-83124 Sep 09 16:32:24.242485 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [req-9b603b01-be50-467e-a02a-f1bca467dbef req-4a092667-8948-4a3b-b0e7-ae6c985a38ad service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127196) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 09 16:32:24.242988 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [req-9b603b01-be50-467e-a02a-f1bca467dbef req-4a092667-8948-4a3b-b0e7-ae6c985a38ad service nova] Acquired lock "compute-rpcapi-router" {{(pid=127196) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 09 16:32:24.244227 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-05b9461a-14f3-48f4-a778-c9b52e9e7d5c None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:24.244759 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-05b9461a-14f3-48f4-a778-c9b52e9e7d5c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:24.245250 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-05b9461a-14f3-48f4-a778-c9b52e9e7d5c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:24.246164 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-05b9461a-14f3-48f4-a778-c9b52e9e7d5c None None] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:24.247203 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-05b9461a-14f3-48f4-a778-c9b52e9e7d5c None None] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:24.247720 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-05b9461a-14f3-48f4-a778-c9b52e9e7d5c None None] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:24.259840 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.compute.rpcapi [None req-05b9461a-14f3-48f4-a778-c9b52e9e7d5c None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 09 16:32:24.261635 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-05b9461a-14f3-48f4-a778-c9b52e9e7d5c None None] Releasing lock "compute-rpcapi-router" {{(pid=127196) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 09 16:32:24.274690 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-d888f804-25fa-47b1-973a-76192ada5937 req-e8a65ff7-c463-4cef-8d58-c86422974864 service nova] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:24.278783 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-d888f804-25fa-47b1-973a-76192ada5937 req-e8a65ff7-c463-4cef-8d58-c86422974864 service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:24.283795 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-d888f804-25fa-47b1-973a-76192ada5937 req-e8a65ff7-c463-4cef-8d58-c86422974864 service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:24.285760 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-05b9461a-14f3-48f4-a778-c9b52e9e7d5c None None] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.181934 Sep 09 16:32:24.286432 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 38/76] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Sep 9 16:32:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:32:24.304743 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.compute.server_external_events [req-d888f804-25fa-47b1-973a-76192ada5937 req-e8a65ff7-c463-4cef-8d58-c86422974864 service nova] Creating event network-changed:a26fe3a3-c8fd-45e4-8105-8c34395addd8 for instance 9e761961-9c74-444c-bb4b-0b2f82a9d698 on hv-cinder-83124 Sep 09 16:32:24.305274 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-d888f804-25fa-47b1-973a-76192ada5937 req-e8a65ff7-c463-4cef-8d58-c86422974864 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127198) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 09 16:32:24.305668 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-d888f804-25fa-47b1-973a-76192ada5937 req-e8a65ff7-c463-4cef-8d58-c86422974864 service nova] Acquired lock "compute-rpcapi-router" {{(pid=127198) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 09 16:32:24.306739 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-54c75f49-1959-4abd-91f0-53bcd92d5730 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:24.307203 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-54c75f49-1959-4abd-91f0-53bcd92d5730 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:24.307630 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-54c75f49-1959-4abd-91f0-53bcd92d5730 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:24.308340 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-54c75f49-1959-4abd-91f0-53bcd92d5730 None None] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:24.308788 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-54c75f49-1959-4abd-91f0-53bcd92d5730 None None] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:24.309210 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-54c75f49-1959-4abd-91f0-53bcd92d5730 None None] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:24.318461 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.compute.rpcapi [None req-54c75f49-1959-4abd-91f0-53bcd92d5730 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 09 16:32:24.319379 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-54c75f49-1959-4abd-91f0-53bcd92d5730 None None] Releasing lock "compute-rpcapi-router" {{(pid=127198) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 09 16:32:24.334706 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-54c75f49-1959-4abd-91f0-53bcd92d5730 None None] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.180183 Sep 09 16:32:24.335497 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 39/77] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Sep 9 16:32:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:32:24.354184 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-b0059e72-eeb9-45b8-b105-bdb15dfe34b4 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:32:24.355971 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-b0059e72-eeb9-45b8-b105-bdb15dfe34b4 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] [instance: 9e761961-9c74-444c-bb4b-0b2f82a9d698] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:32:24.361124 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-b0059e72-eeb9-45b8-b105-bdb15dfe34b4 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:24.361609 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-b0059e72-eeb9-45b8-b105-bdb15dfe34b4 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:24.361833 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-e9f85555-676e-496f-8b7e-5c888ecbe85e tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:32:24.362041 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-b0059e72-eeb9-45b8-b105-bdb15dfe34b4 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:24.362569 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-e9f85555-676e-496f-8b7e-5c888ecbe85e tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] [instance: 15d68c64-0569-4afa-a718-bc0e0c2cba3e] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:32:24.362762 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-b0059e72-eeb9-45b8-b105-bdb15dfe34b4 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:24.363367 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-b0059e72-eeb9-45b8-b105-bdb15dfe34b4 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:24.363940 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-b0059e72-eeb9-45b8-b105-bdb15dfe34b4 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:24.370010 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e9f85555-676e-496f-8b7e-5c888ecbe85e tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:24.370542 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e9f85555-676e-496f-8b7e-5c888ecbe85e tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:24.370974 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e9f85555-676e-496f-8b7e-5c888ecbe85e tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:24.371676 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e9f85555-676e-496f-8b7e-5c888ecbe85e tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:24.372132 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e9f85555-676e-496f-8b7e-5c888ecbe85e tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:24.372616 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e9f85555-676e-496f-8b7e-5c888ecbe85e tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:24.571973 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-b0059e72-eeb9-45b8-b105-bdb15dfe34b4 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd095ed814b9e47e08d6b5a4fd2901c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f2e0c002343d88ae25dc7bfb2fe10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:32:24.575410 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-e9f85555-676e-496f-8b7e-5c888ecbe85e tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce1cd9c19584549b794df8e487abf00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f227ee89ce84dec84410a1db9b479fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:32:24.579873 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-b0059e72-eeb9-45b8-b105-bdb15dfe34b4 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] 10.222.0.23 "GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698" status: 200 len: 1362 microversion: 2.1 time: 0.230294 Sep 09 16:32:24.580444 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 39/78] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:32:24 2022] GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698 => generated 1362 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:32:24.583821 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-e9f85555-676e-496f-8b7e-5c888ecbe85e tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] 10.222.0.23 "GET /compute/v2.1/servers/15d68c64-0569-4afa-a718-bc0e0c2cba3e" status: 200 len: 1313 microversion: 2.1 time: 0.226293 Sep 09 16:32:24.584470 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 40/79] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:32:24 2022] GET /compute/v2.1/servers/15d68c64-0569-4afa-a718-bc0e0c2cba3e => generated 1313 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:32:24.585378 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-1b86b972-d44a-42ea-be17-d49d1c3adef6 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:32:24.586182 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-1b86b972-d44a-42ea-be17-d49d1c3adef6 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: e8d23cb3-2f39-4b00-ae9d-006e392a5940] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:32:24.592273 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-1b86b972-d44a-42ea-be17-d49d1c3adef6 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:24.592717 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-1b86b972-d44a-42ea-be17-d49d1c3adef6 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:24.593331 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-1b86b972-d44a-42ea-be17-d49d1c3adef6 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:24.594032 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-1b86b972-d44a-42ea-be17-d49d1c3adef6 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:24.594466 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-1b86b972-d44a-42ea-be17-d49d1c3adef6 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:24.594949 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-1b86b972-d44a-42ea-be17-d49d1c3adef6 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:24.732839 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-1b86b972-d44a-42ea-be17-d49d1c3adef6 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d86f09c6304121be2021cb5c15e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ab544d0b547919794e3efb49ba0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:32:24.740593 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-1b86b972-d44a-42ea-be17-d49d1c3adef6 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940" status: 200 len: 1322 microversion: 2.1 time: 0.159197 Sep 09 16:32:24.741153 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 40/80] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:32:24 2022] GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940 => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:32:24.895921 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-47bea3eb-05e4-4f62-9ace-297a54414429 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:32:24.896561 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-47bea3eb-05e4-4f62-9ace-297a54414429 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] [instance: c453c474-644e-4e46-9d23-b2b87716f5d7] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:32:24.903291 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-47bea3eb-05e4-4f62-9ace-297a54414429 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:24.903792 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-47bea3eb-05e4-4f62-9ace-297a54414429 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:24.904240 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-47bea3eb-05e4-4f62-9ace-297a54414429 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:24.904949 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-47bea3eb-05e4-4f62-9ace-297a54414429 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:24.905414 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-47bea3eb-05e4-4f62-9ace-297a54414429 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:24.905852 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-47bea3eb-05e4-4f62-9ace-297a54414429 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:25.036822 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-47bea3eb-05e4-4f62-9ace-297a54414429 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c0721dc18343b18993ff5af098841d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17967a941be4a04bbc180e2cf3a7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:32:25.045033 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-47bea3eb-05e4-4f62-9ace-297a54414429 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] 10.222.0.23 "GET /compute/v2.1/servers/c453c474-644e-4e46-9d23-b2b87716f5d7" status: 200 len: 1366 microversion: 2.1 time: 0.155758 Sep 09 16:32:25.045594 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 41/81] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:32:24 2022] GET /compute/v2.1/servers/c453c474-644e-4e46-9d23-b2b87716f5d7 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:32:25.602301 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-89459870-669d-4155-a826-712a0b3d31c6 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:32:25.603757 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-89459870-669d-4155-a826-712a0b3d31c6 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] [instance: 9e761961-9c74-444c-bb4b-0b2f82a9d698] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:32:25.609614 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-51ea48a6-b914-4216-a844-2cfebe2354d4 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:32:25.610392 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-51ea48a6-b914-4216-a844-2cfebe2354d4 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] [instance: 15d68c64-0569-4afa-a718-bc0e0c2cba3e] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:32:25.610687 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-89459870-669d-4155-a826-712a0b3d31c6 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:25.611383 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-89459870-669d-4155-a826-712a0b3d31c6 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:25.612026 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-89459870-669d-4155-a826-712a0b3d31c6 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:25.612919 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-89459870-669d-4155-a826-712a0b3d31c6 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:25.613591 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-89459870-669d-4155-a826-712a0b3d31c6 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:25.614205 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-89459870-669d-4155-a826-712a0b3d31c6 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:25.619596 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-51ea48a6-b914-4216-a844-2cfebe2354d4 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:25.620285 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-51ea48a6-b914-4216-a844-2cfebe2354d4 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:25.620936 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-51ea48a6-b914-4216-a844-2cfebe2354d4 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:25.621834 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-51ea48a6-b914-4216-a844-2cfebe2354d4 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:25.622977 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-51ea48a6-b914-4216-a844-2cfebe2354d4 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:25.623809 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-51ea48a6-b914-4216-a844-2cfebe2354d4 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:25.859643 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-51ea48a6-b914-4216-a844-2cfebe2354d4 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce1cd9c19584549b794df8e487abf00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f227ee89ce84dec84410a1db9b479fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:32:25.863054 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-89459870-669d-4155-a826-712a0b3d31c6 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd095ed814b9e47e08d6b5a4fd2901c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f2e0c002343d88ae25dc7bfb2fe10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:32:25.871234 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-89459870-669d-4155-a826-712a0b3d31c6 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] 10.222.0.23 "GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698" status: 200 len: 1362 microversion: 2.1 time: 0.273285 Sep 09 16:32:25.879030 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 41/82] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:32:25 2022] GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698 => generated 1362 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:32:25.885254 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-e0248233-0ed8-475c-99b5-4b7f722b2a48 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:32:25.886070 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-e0248233-0ed8-475c-99b5-4b7f722b2a48 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: e8d23cb3-2f39-4b00-ae9d-006e392a5940] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:32:25.892423 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e0248233-0ed8-475c-99b5-4b7f722b2a48 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:25.893023 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e0248233-0ed8-475c-99b5-4b7f722b2a48 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:25.893659 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e0248233-0ed8-475c-99b5-4b7f722b2a48 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:25.894439 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e0248233-0ed8-475c-99b5-4b7f722b2a48 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:25.895011 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e0248233-0ed8-475c-99b5-4b7f722b2a48 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:25.895544 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e0248233-0ed8-475c-99b5-4b7f722b2a48 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:25.919008 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-51ea48a6-b914-4216-a844-2cfebe2354d4 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] 10.222.0.23 "GET /compute/v2.1/servers/15d68c64-0569-4afa-a718-bc0e0c2cba3e" status: 200 len: 1313 microversion: 2.1 time: 0.315129 Sep 09 16:32:25.922212 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 42/83] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:32:25 2022] GET /compute/v2.1/servers/15d68c64-0569-4afa-a718-bc0e0c2cba3e => generated 1313 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 16:32:26.068814 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-133afd20-c793-4410-9ac4-0dc0b33b8d2d tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:32:26.069432 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-133afd20-c793-4410-9ac4-0dc0b33b8d2d tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] [instance: c453c474-644e-4e46-9d23-b2b87716f5d7] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:32:26.091384 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-133afd20-c793-4410-9ac4-0dc0b33b8d2d tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:26.091857 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-133afd20-c793-4410-9ac4-0dc0b33b8d2d tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:26.092335 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-133afd20-c793-4410-9ac4-0dc0b33b8d2d tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:26.093071 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-133afd20-c793-4410-9ac4-0dc0b33b8d2d tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:26.093514 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-133afd20-c793-4410-9ac4-0dc0b33b8d2d tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:26.094187 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-133afd20-c793-4410-9ac4-0dc0b33b8d2d tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:26.108675 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-e0248233-0ed8-475c-99b5-4b7f722b2a48 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d86f09c6304121be2021cb5c15e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ab544d0b547919794e3efb49ba0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:32:26.117734 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-e0248233-0ed8-475c-99b5-4b7f722b2a48 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940" status: 200 len: 1322 microversion: 2.1 time: 0.236474 Sep 09 16:32:26.125124 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 42/84] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:32:25 2022] GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940 => generated 1322 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:32:26.262807 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-133afd20-c793-4410-9ac4-0dc0b33b8d2d tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c0721dc18343b18993ff5af098841d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17967a941be4a04bbc180e2cf3a7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:32:26.270362 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-133afd20-c793-4410-9ac4-0dc0b33b8d2d tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] 10.222.0.23 "GET /compute/v2.1/servers/c453c474-644e-4e46-9d23-b2b87716f5d7" status: 200 len: 1366 microversion: 2.1 time: 0.205739 Sep 09 16:32:26.271020 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 43/85] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:32:26 2022] GET /compute/v2.1/servers/c453c474-644e-4e46-9d23-b2b87716f5d7 => generated 1366 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 16:32:26.301854 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [req-2d0cd544-ab1e-487d-91b8-708299e9005d req-cb9356e1-7560-4a84-aa5c-e57b1423ffed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc41312a-3de8-4584-9bcf-a1f31b952025", "tag": "fe97fa1b-e830-46b1-ba10-d58f1d1269f2"}]} {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:32:26.311451 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [req-2d0cd544-ab1e-487d-91b8-708299e9005d req-cb9356e1-7560-4a84-aa5c-e57b1423ffed service nova] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:26.312013 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [req-2d0cd544-ab1e-487d-91b8-708299e9005d req-cb9356e1-7560-4a84-aa5c-e57b1423ffed service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:26.312566 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [req-2d0cd544-ab1e-487d-91b8-708299e9005d req-cb9356e1-7560-4a84-aa5c-e57b1423ffed service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:26.323556 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.compute.server_external_events [req-2d0cd544-ab1e-487d-91b8-708299e9005d req-cb9356e1-7560-4a84-aa5c-e57b1423ffed service nova] Creating event network-changed:fe97fa1b-e830-46b1-ba10-d58f1d1269f2 for instance cc41312a-3de8-4584-9bcf-a1f31b952025 on hv-cinder-83124 Sep 09 16:32:26.328884 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [req-2d0cd544-ab1e-487d-91b8-708299e9005d req-cb9356e1-7560-4a84-aa5c-e57b1423ffed service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030707 Sep 09 16:32:26.329396 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 43/86] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Sep 9 16:32:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:32:26.351698 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [req-f9ea8bbe-890b-49d5-a4a5-475b258015d6 req-7e3ba209-b352-4972-b022-16f08b96abc3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c453c474-644e-4e46-9d23-b2b87716f5d7", "tag": "4976ea2e-5f69-46bc-9cfb-142523115ea4"}]} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:32:26.361903 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-f9ea8bbe-890b-49d5-a4a5-475b258015d6 req-7e3ba209-b352-4972-b022-16f08b96abc3 service nova] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:26.362382 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-f9ea8bbe-890b-49d5-a4a5-475b258015d6 req-7e3ba209-b352-4972-b022-16f08b96abc3 service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:26.362933 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-f9ea8bbe-890b-49d5-a4a5-475b258015d6 req-7e3ba209-b352-4972-b022-16f08b96abc3 service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:26.374017 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.compute.server_external_events [req-f9ea8bbe-890b-49d5-a4a5-475b258015d6 req-7e3ba209-b352-4972-b022-16f08b96abc3 service nova] Creating event network-changed:4976ea2e-5f69-46bc-9cfb-142523115ea4 for instance c453c474-644e-4e46-9d23-b2b87716f5d7 on hv-cinder-83124 Sep 09 16:32:26.379070 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [req-f9ea8bbe-890b-49d5-a4a5-475b258015d6 req-7e3ba209-b352-4972-b022-16f08b96abc3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030956 Sep 09 16:32:26.379662 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 44/87] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Sep 9 16:32:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:32:26.918009 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-8fc05f49-feec-4beb-9f35-b7a9fbed0b70 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:32:26.920583 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-8fc05f49-feec-4beb-9f35-b7a9fbed0b70 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] [instance: 9e761961-9c74-444c-bb4b-0b2f82a9d698] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:32:26.925725 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-8fc05f49-feec-4beb-9f35-b7a9fbed0b70 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:26.926201 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-8fc05f49-feec-4beb-9f35-b7a9fbed0b70 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:26.926718 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-8fc05f49-feec-4beb-9f35-b7a9fbed0b70 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:26.927550 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-8fc05f49-feec-4beb-9f35-b7a9fbed0b70 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:26.927999 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-8fc05f49-feec-4beb-9f35-b7a9fbed0b70 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:26.928635 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-8fc05f49-feec-4beb-9f35-b7a9fbed0b70 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:26.945870 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-ef6d57fb-0e35-4e26-8d60-255cf1d91d07 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:32:26.946720 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-ef6d57fb-0e35-4e26-8d60-255cf1d91d07 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] [instance: 15d68c64-0569-4afa-a718-bc0e0c2cba3e] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:32:26.953165 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ef6d57fb-0e35-4e26-8d60-255cf1d91d07 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:26.953767 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ef6d57fb-0e35-4e26-8d60-255cf1d91d07 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:26.954343 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ef6d57fb-0e35-4e26-8d60-255cf1d91d07 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:26.955129 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ef6d57fb-0e35-4e26-8d60-255cf1d91d07 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:26.955833 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ef6d57fb-0e35-4e26-8d60-255cf1d91d07 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:26.956247 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ef6d57fb-0e35-4e26-8d60-255cf1d91d07 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:27.125210 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-8fc05f49-feec-4beb-9f35-b7a9fbed0b70 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd095ed814b9e47e08d6b5a4fd2901c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f2e0c002343d88ae25dc7bfb2fe10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:32:27.133694 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-ef6d57fb-0e35-4e26-8d60-255cf1d91d07 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce1cd9c19584549b794df8e487abf00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f227ee89ce84dec84410a1db9b479fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:32:27.135377 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-8fc05f49-feec-4beb-9f35-b7a9fbed0b70 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] 10.222.0.23 "GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698" status: 200 len: 1362 microversion: 2.1 time: 0.221345 Sep 09 16:32:27.135968 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 44/88] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:32:26 2022] GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698 => generated 1362 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:32:27.140417 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-20ecb72f-7125-4fda-8807-ae6ebb18b077 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:32:27.141079 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-20ecb72f-7125-4fda-8807-ae6ebb18b077 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: e8d23cb3-2f39-4b00-ae9d-006e392a5940] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:32:27.141770 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-ef6d57fb-0e35-4e26-8d60-255cf1d91d07 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] 10.222.0.23 "GET /compute/v2.1/servers/15d68c64-0569-4afa-a718-bc0e0c2cba3e" status: 200 len: 1313 microversion: 2.1 time: 0.200460 Sep 09 16:32:27.142336 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 45/89] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:32:26 2022] GET /compute/v2.1/servers/15d68c64-0569-4afa-a718-bc0e0c2cba3e => generated 1313 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:32:27.147093 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-20ecb72f-7125-4fda-8807-ae6ebb18b077 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:27.147569 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-20ecb72f-7125-4fda-8807-ae6ebb18b077 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:27.147993 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-20ecb72f-7125-4fda-8807-ae6ebb18b077 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:27.148676 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-20ecb72f-7125-4fda-8807-ae6ebb18b077 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:27.149116 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-20ecb72f-7125-4fda-8807-ae6ebb18b077 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:27.149530 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-20ecb72f-7125-4fda-8807-ae6ebb18b077 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:27.284207 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-20ecb72f-7125-4fda-8807-ae6ebb18b077 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d86f09c6304121be2021cb5c15e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ab544d0b547919794e3efb49ba0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:32:27.293734 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-f65ac8a2-9493-4b7c-95bf-0af1101031eb tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:32:27.294140 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-20ecb72f-7125-4fda-8807-ae6ebb18b077 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940" status: 200 len: 1322 microversion: 2.1 time: 0.157095 Sep 09 16:32:27.294640 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-f65ac8a2-9493-4b7c-95bf-0af1101031eb tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] [instance: c453c474-644e-4e46-9d23-b2b87716f5d7] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:32:27.294818 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 45/90] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:32:27 2022] GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940 => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:32:27.301912 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f65ac8a2-9493-4b7c-95bf-0af1101031eb tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:27.302533 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f65ac8a2-9493-4b7c-95bf-0af1101031eb tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:27.302985 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f65ac8a2-9493-4b7c-95bf-0af1101031eb tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:27.303667 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f65ac8a2-9493-4b7c-95bf-0af1101031eb tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:27.304110 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f65ac8a2-9493-4b7c-95bf-0af1101031eb tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:27.304523 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f65ac8a2-9493-4b7c-95bf-0af1101031eb tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:27.439719 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-f65ac8a2-9493-4b7c-95bf-0af1101031eb tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c0721dc18343b18993ff5af098841d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17967a941be4a04bbc180e2cf3a7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:32:27.447538 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-f65ac8a2-9493-4b7c-95bf-0af1101031eb tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] 10.222.0.23 "GET /compute/v2.1/servers/c453c474-644e-4e46-9d23-b2b87716f5d7" status: 200 len: 1366 microversion: 2.1 time: 0.157998 Sep 09 16:32:27.448122 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 46/91] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:32:27 2022] GET /compute/v2.1/servers/c453c474-644e-4e46-9d23-b2b87716f5d7 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:32:28.161766 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-dcec0bc0-cbe7-4293-b005-9199998af8fc tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:32:28.162816 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-dcec0bc0-cbe7-4293-b005-9199998af8fc tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] [instance: 9e761961-9c74-444c-bb4b-0b2f82a9d698] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:32:28.168683 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-29a90676-f16a-4675-ae94-4a924ead0439 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:32:28.169882 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-29a90676-f16a-4675-ae94-4a924ead0439 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] [instance: 15d68c64-0569-4afa-a718-bc0e0c2cba3e] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:32:28.172578 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-dcec0bc0-cbe7-4293-b005-9199998af8fc tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:28.173374 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-dcec0bc0-cbe7-4293-b005-9199998af8fc tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:28.174576 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-dcec0bc0-cbe7-4293-b005-9199998af8fc tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:28.175709 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-dcec0bc0-cbe7-4293-b005-9199998af8fc tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:28.176458 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-dcec0bc0-cbe7-4293-b005-9199998af8fc tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:28.177208 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-dcec0bc0-cbe7-4293-b005-9199998af8fc tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:28.179049 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-29a90676-f16a-4675-ae94-4a924ead0439 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:28.179535 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-29a90676-f16a-4675-ae94-4a924ead0439 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:28.179962 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-29a90676-f16a-4675-ae94-4a924ead0439 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:28.180631 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-29a90676-f16a-4675-ae94-4a924ead0439 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:28.181083 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-29a90676-f16a-4675-ae94-4a924ead0439 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:28.181501 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-29a90676-f16a-4675-ae94-4a924ead0439 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:28.701117 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-dcec0bc0-cbe7-4293-b005-9199998af8fc tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd095ed814b9e47e08d6b5a4fd2901c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f2e0c002343d88ae25dc7bfb2fe10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:32:28.711932 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-dcec0bc0-cbe7-4293-b005-9199998af8fc tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] 10.222.0.23 "GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698" status: 200 len: 1362 microversion: 2.1 time: 0.556587 Sep 09 16:32:28.717319 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 46/92] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:32:28 2022] GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698 => generated 1362 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:32:28.731989 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-29a90676-f16a-4675-ae94-4a924ead0439 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce1cd9c19584549b794df8e487abf00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f227ee89ce84dec84410a1db9b479fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:32:28.737253 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-29a90676-f16a-4675-ae94-4a924ead0439 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] 10.222.0.23 "GET /compute/v2.1/servers/15d68c64-0569-4afa-a718-bc0e0c2cba3e" status: 200 len: 1313 microversion: 2.1 time: 0.574202 Sep 09 16:32:28.746771 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 47/93] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:32:28 2022] GET /compute/v2.1/servers/15d68c64-0569-4afa-a718-bc0e0c2cba3e => generated 1313 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:32:28.752872 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-116c877e-2480-4837-8786-70e89ade9d9f tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:32:28.754085 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [req-abd63ceb-842d-469f-908f-fcb5886a2ed7 req-0f883262-11e2-4720-97b5-9194af91c19a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8d23cb3-2f39-4b00-ae9d-006e392a5940", "tag": "98eca583-6399-4702-a0d5-6321d1da9439"}]} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:32:28.754943 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-116c877e-2480-4837-8786-70e89ade9d9f tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: e8d23cb3-2f39-4b00-ae9d-006e392a5940] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:32:28.765516 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-116c877e-2480-4837-8786-70e89ade9d9f tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:28.766162 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-116c877e-2480-4837-8786-70e89ade9d9f tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:28.768026 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-116c877e-2480-4837-8786-70e89ade9d9f tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:28.768947 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-116c877e-2480-4837-8786-70e89ade9d9f tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:28.769542 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-116c877e-2480-4837-8786-70e89ade9d9f tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:28.770059 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-116c877e-2480-4837-8786-70e89ade9d9f tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:28.775618 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG dbcounter [-] [127196] Writing DB stats nova_cell1:SELECT=100 {{(pid=127196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:32:28.794872 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-abd63ceb-842d-469f-908f-fcb5886a2ed7 req-0f883262-11e2-4720-97b5-9194af91c19a service nova] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:28.795649 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-abd63ceb-842d-469f-908f-fcb5886a2ed7 req-0f883262-11e2-4720-97b5-9194af91c19a service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:28.796082 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-abd63ceb-842d-469f-908f-fcb5886a2ed7 req-0f883262-11e2-4720-97b5-9194af91c19a service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:28.820752 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.compute.server_external_events [req-abd63ceb-842d-469f-908f-fcb5886a2ed7 req-0f883262-11e2-4720-97b5-9194af91c19a service nova] Creating event network-changed:98eca583-6399-4702-a0d5-6321d1da9439 for instance e8d23cb3-2f39-4b00-ae9d-006e392a5940 on hv-cinder-83124 Sep 09 16:32:28.827249 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [req-abd63ceb-842d-469f-908f-fcb5886a2ed7 req-0f883262-11e2-4720-97b5-9194af91c19a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085415 Sep 09 16:32:28.828970 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 48/94] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Sep 9 16:32:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:32:28.835684 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-1404baa8-ad55-462c-84a3-b802620353af tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:32:28.836469 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-1404baa8-ad55-462c-84a3-b802620353af tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] [instance: c453c474-644e-4e46-9d23-b2b87716f5d7] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:32:28.843670 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1404baa8-ad55-462c-84a3-b802620353af tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:28.844150 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1404baa8-ad55-462c-84a3-b802620353af tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:28.845154 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1404baa8-ad55-462c-84a3-b802620353af tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:28.846067 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1404baa8-ad55-462c-84a3-b802620353af tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:28.846531 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1404baa8-ad55-462c-84a3-b802620353af tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:28.847444 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1404baa8-ad55-462c-84a3-b802620353af tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:28.976687 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-116c877e-2480-4837-8786-70e89ade9d9f tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d86f09c6304121be2021cb5c15e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ab544d0b547919794e3efb49ba0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:32:28.984618 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-116c877e-2480-4837-8786-70e89ade9d9f tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940" status: 200 len: 1322 microversion: 2.1 time: 0.250582 Sep 09 16:32:28.985299 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 47/95] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:32:28 2022] GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940 => generated 1322 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:32:29.008204 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-1404baa8-ad55-462c-84a3-b802620353af tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c0721dc18343b18993ff5af098841d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17967a941be4a04bbc180e2cf3a7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:32:29.016210 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-1404baa8-ad55-462c-84a3-b802620353af tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] 10.222.0.23 "GET /compute/v2.1/servers/c453c474-644e-4e46-9d23-b2b87716f5d7" status: 200 len: 1366 microversion: 2.1 time: 0.185996 Sep 09 16:32:29.016783 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 49/96] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:32:28 2022] GET /compute/v2.1/servers/c453c474-644e-4e46-9d23-b2b87716f5d7 => generated 1366 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:32:29.745652 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-80ada37e-66b4-4e49-b5d5-6507bb76e3c2 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:32:29.746274 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-80ada37e-66b4-4e49-b5d5-6507bb76e3c2 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] [instance: 9e761961-9c74-444c-bb4b-0b2f82a9d698] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:32:29.753556 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-80ada37e-66b4-4e49-b5d5-6507bb76e3c2 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:29.754033 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-80ada37e-66b4-4e49-b5d5-6507bb76e3c2 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:29.754459 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-80ada37e-66b4-4e49-b5d5-6507bb76e3c2 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:29.755218 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-80ada37e-66b4-4e49-b5d5-6507bb76e3c2 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:29.755665 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-80ada37e-66b4-4e49-b5d5-6507bb76e3c2 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:29.756219 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-80ada37e-66b4-4e49-b5d5-6507bb76e3c2 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:29.761689 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-ee2d824e-c50d-43ff-931c-1f971d2f74c0 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:32:29.762763 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-ee2d824e-c50d-43ff-931c-1f971d2f74c0 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] [instance: 15d68c64-0569-4afa-a718-bc0e0c2cba3e] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:32:29.770718 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ee2d824e-c50d-43ff-931c-1f971d2f74c0 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:29.771487 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ee2d824e-c50d-43ff-931c-1f971d2f74c0 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:29.772166 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ee2d824e-c50d-43ff-931c-1f971d2f74c0 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:29.773213 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ee2d824e-c50d-43ff-931c-1f971d2f74c0 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:29.774311 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ee2d824e-c50d-43ff-931c-1f971d2f74c0 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:29.774770 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ee2d824e-c50d-43ff-931c-1f971d2f74c0 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:29.956057 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-80ada37e-66b4-4e49-b5d5-6507bb76e3c2 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd095ed814b9e47e08d6b5a4fd2901c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f2e0c002343d88ae25dc7bfb2fe10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:32:29.963891 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-80ada37e-66b4-4e49-b5d5-6507bb76e3c2 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] 10.222.0.23 "GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698" status: 200 len: 1362 microversion: 2.1 time: 0.222703 Sep 09 16:32:29.964472 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 48/97] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:32:29 2022] GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698 => generated 1362 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:32:29.967197 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-ee2d824e-c50d-43ff-931c-1f971d2f74c0 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce1cd9c19584549b794df8e487abf00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f227ee89ce84dec84410a1db9b479fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:32:29.975539 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-ee2d824e-c50d-43ff-931c-1f971d2f74c0 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] 10.222.0.23 "GET /compute/v2.1/servers/15d68c64-0569-4afa-a718-bc0e0c2cba3e" status: 200 len: 1313 microversion: 2.1 time: 0.219355 Sep 09 16:32:29.976182 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 50/98] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:32:29 2022] GET /compute/v2.1/servers/15d68c64-0569-4afa-a718-bc0e0c2cba3e => generated 1313 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:32:30.006866 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-bfa42640-8d6e-40f2-be1a-c119e4261e5c tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:32:30.007479 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-bfa42640-8d6e-40f2-be1a-c119e4261e5c tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: e8d23cb3-2f39-4b00-ae9d-006e392a5940] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:32:30.013737 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-bfa42640-8d6e-40f2-be1a-c119e4261e5c tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:30.014222 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-bfa42640-8d6e-40f2-be1a-c119e4261e5c tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:30.014735 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-bfa42640-8d6e-40f2-be1a-c119e4261e5c tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:30.015435 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-bfa42640-8d6e-40f2-be1a-c119e4261e5c tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:30.015898 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-bfa42640-8d6e-40f2-be1a-c119e4261e5c tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:30.016327 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-bfa42640-8d6e-40f2-be1a-c119e4261e5c tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:30.038344 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-da05b66a-e147-47bc-903a-851e2a482ab6 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:32:30.039113 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-da05b66a-e147-47bc-903a-851e2a482ab6 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] [instance: c453c474-644e-4e46-9d23-b2b87716f5d7] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:32:30.045283 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-da05b66a-e147-47bc-903a-851e2a482ab6 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:30.045835 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-da05b66a-e147-47bc-903a-851e2a482ab6 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:30.046327 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-da05b66a-e147-47bc-903a-851e2a482ab6 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:30.047179 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-da05b66a-e147-47bc-903a-851e2a482ab6 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:30.047646 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-da05b66a-e147-47bc-903a-851e2a482ab6 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:30.048127 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-da05b66a-e147-47bc-903a-851e2a482ab6 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:30.215551 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-bfa42640-8d6e-40f2-be1a-c119e4261e5c tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d86f09c6304121be2021cb5c15e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ab544d0b547919794e3efb49ba0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:32:30.222368 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-da05b66a-e147-47bc-903a-851e2a482ab6 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c0721dc18343b18993ff5af098841d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17967a941be4a04bbc180e2cf3a7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:32:30.223519 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-bfa42640-8d6e-40f2-be1a-c119e4261e5c tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940" status: 200 len: 1322 microversion: 2.1 time: 0.220675 Sep 09 16:32:30.224108 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 49/99] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:32:30 2022] GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940 => generated 1322 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:32:30.230522 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-da05b66a-e147-47bc-903a-851e2a482ab6 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] 10.222.0.23 "GET /compute/v2.1/servers/c453c474-644e-4e46-9d23-b2b87716f5d7" status: 200 len: 1366 microversion: 2.1 time: 0.195920 Sep 09 16:32:30.231098 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 51/100] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:32:30 2022] GET /compute/v2.1/servers/c453c474-644e-4e46-9d23-b2b87716f5d7 => generated 1366 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 16:32:30.988155 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-0aa81496-2128-45e4-8b16-677f1e0a024f tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:32:30.988760 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-0aa81496-2128-45e4-8b16-677f1e0a024f tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] [instance: 9e761961-9c74-444c-bb4b-0b2f82a9d698] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:32:30.995180 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-0aa81496-2128-45e4-8b16-677f1e0a024f tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:30.995671 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-0aa81496-2128-45e4-8b16-677f1e0a024f tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:30.996103 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-0aa81496-2128-45e4-8b16-677f1e0a024f tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:30.996789 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-0aa81496-2128-45e4-8b16-677f1e0a024f tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:30.997241 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-0aa81496-2128-45e4-8b16-677f1e0a024f tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:30.997339 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-70611a11-a26d-49f7-9754-a319b0cbf9a0 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:32:30.997731 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-0aa81496-2128-45e4-8b16-677f1e0a024f tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:30.998202 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-70611a11-a26d-49f7-9754-a319b0cbf9a0 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] [instance: 15d68c64-0569-4afa-a718-bc0e0c2cba3e] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:32:31.004649 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-70611a11-a26d-49f7-9754-a319b0cbf9a0 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:31.005377 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-70611a11-a26d-49f7-9754-a319b0cbf9a0 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:31.005814 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-70611a11-a26d-49f7-9754-a319b0cbf9a0 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:31.006530 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-70611a11-a26d-49f7-9754-a319b0cbf9a0 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:31.007075 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-70611a11-a26d-49f7-9754-a319b0cbf9a0 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:31.007504 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-70611a11-a26d-49f7-9754-a319b0cbf9a0 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:31.018721 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell1:SELECT=100 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:32:31.190702 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-0aa81496-2128-45e4-8b16-677f1e0a024f tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd095ed814b9e47e08d6b5a4fd2901c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f2e0c002343d88ae25dc7bfb2fe10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:32:31.194084 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-70611a11-a26d-49f7-9754-a319b0cbf9a0 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce1cd9c19584549b794df8e487abf00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f227ee89ce84dec84410a1db9b479fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:32:31.198775 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-0aa81496-2128-45e4-8b16-677f1e0a024f tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] 10.222.0.23 "GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698" status: 200 len: 1362 microversion: 2.1 time: 0.214470 Sep 09 16:32:31.199360 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 50/101] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:32:30 2022] GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698 => generated 1362 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:32:31.201792 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-70611a11-a26d-49f7-9754-a319b0cbf9a0 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] 10.222.0.23 "GET /compute/v2.1/servers/15d68c64-0569-4afa-a718-bc0e0c2cba3e" status: 200 len: 1313 microversion: 2.1 time: 0.208383 Sep 09 16:32:31.202366 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 52/102] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:32:30 2022] GET /compute/v2.1/servers/15d68c64-0569-4afa-a718-bc0e0c2cba3e => generated 1313 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:32:31.246163 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-85e576a0-f983-45d3-a2a8-1d33db262481 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:32:31.246809 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-85e576a0-f983-45d3-a2a8-1d33db262481 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: e8d23cb3-2f39-4b00-ae9d-006e392a5940] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:32:31.252958 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-85e576a0-f983-45d3-a2a8-1d33db262481 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:31.253122 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-0944a352-3032-48fb-9a6d-1d67d7350949 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:32:31.253583 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-85e576a0-f983-45d3-a2a8-1d33db262481 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:31.253762 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-0944a352-3032-48fb-9a6d-1d67d7350949 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] [instance: c453c474-644e-4e46-9d23-b2b87716f5d7] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:32:31.254014 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-85e576a0-f983-45d3-a2a8-1d33db262481 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:31.254740 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-85e576a0-f983-45d3-a2a8-1d33db262481 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:31.255240 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-85e576a0-f983-45d3-a2a8-1d33db262481 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:31.255663 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-85e576a0-f983-45d3-a2a8-1d33db262481 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:31.259997 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0944a352-3032-48fb-9a6d-1d67d7350949 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:31.260479 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0944a352-3032-48fb-9a6d-1d67d7350949 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:31.260918 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0944a352-3032-48fb-9a6d-1d67d7350949 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:31.261618 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0944a352-3032-48fb-9a6d-1d67d7350949 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:31.262063 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0944a352-3032-48fb-9a6d-1d67d7350949 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:31.262483 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0944a352-3032-48fb-9a6d-1d67d7350949 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:31.754792 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-85e576a0-f983-45d3-a2a8-1d33db262481 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d86f09c6304121be2021cb5c15e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ab544d0b547919794e3efb49ba0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:32:31.765238 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-85e576a0-f983-45d3-a2a8-1d33db262481 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940" status: 200 len: 1322 microversion: 2.1 time: 0.522661 Sep 09 16:32:31.766382 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 51/103] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:32:31 2022] GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940 => generated 1322 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:32:31.771988 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-0944a352-3032-48fb-9a6d-1d67d7350949 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c0721dc18343b18993ff5af098841d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17967a941be4a04bbc180e2cf3a7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:32:31.783194 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-0944a352-3032-48fb-9a6d-1d67d7350949 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] 10.222.0.23 "GET /compute/v2.1/servers/c453c474-644e-4e46-9d23-b2b87716f5d7" status: 200 len: 1366 microversion: 2.1 time: 0.533706 Sep 09 16:32:31.791764 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 53/104] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:32:31 2022] GET /compute/v2.1/servers/c453c474-644e-4e46-9d23-b2b87716f5d7 => generated 1366 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:32:32.222078 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-cf449dbe-630d-4205-9c02-efc121b69dc3 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:32:32.222841 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-cf449dbe-630d-4205-9c02-efc121b69dc3 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] [instance: 9e761961-9c74-444c-bb4b-0b2f82a9d698] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:32:32.224643 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-1d8dc211-1c02-47c6-9337-b3fc7850ec34 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:32:32.225271 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-1d8dc211-1c02-47c6-9337-b3fc7850ec34 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] [instance: 15d68c64-0569-4afa-a718-bc0e0c2cba3e] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:32:32.230252 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-cf449dbe-630d-4205-9c02-efc121b69dc3 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:32.230794 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-cf449dbe-630d-4205-9c02-efc121b69dc3 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:32.231204 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-cf449dbe-630d-4205-9c02-efc121b69dc3 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:32.231725 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1d8dc211-1c02-47c6-9337-b3fc7850ec34 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:32.231931 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-cf449dbe-630d-4205-9c02-efc121b69dc3 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:32.232219 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1d8dc211-1c02-47c6-9337-b3fc7850ec34 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:32.232422 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-cf449dbe-630d-4205-9c02-efc121b69dc3 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:32.232654 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1d8dc211-1c02-47c6-9337-b3fc7850ec34 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:32.232869 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-cf449dbe-630d-4205-9c02-efc121b69dc3 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:32.233343 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1d8dc211-1c02-47c6-9337-b3fc7850ec34 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:32.233778 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1d8dc211-1c02-47c6-9337-b3fc7850ec34 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:32.234197 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1d8dc211-1c02-47c6-9337-b3fc7850ec34 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:32.453323 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-1d8dc211-1c02-47c6-9337-b3fc7850ec34 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce1cd9c19584549b794df8e487abf00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f227ee89ce84dec84410a1db9b479fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:32:32.455168 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-cf449dbe-630d-4205-9c02-efc121b69dc3 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd095ed814b9e47e08d6b5a4fd2901c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f2e0c002343d88ae25dc7bfb2fe10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:32:32.463510 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-1d8dc211-1c02-47c6-9337-b3fc7850ec34 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] 10.222.0.23 "GET /compute/v2.1/servers/15d68c64-0569-4afa-a718-bc0e0c2cba3e" status: 200 len: 1313 microversion: 2.1 time: 0.242859 Sep 09 16:32:32.464681 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-cf449dbe-630d-4205-9c02-efc121b69dc3 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] 10.222.0.23 "GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698" status: 200 len: 1362 microversion: 2.1 time: 0.246039 Sep 09 16:32:32.465876 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 52/105] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:32:32 2022] GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698 => generated 1362 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:32:32.466105 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 54/106] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:32:32 2022] GET /compute/v2.1/servers/15d68c64-0569-4afa-a718-bc0e0c2cba3e => generated 1313 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:32:32.791213 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-accf3183-6a5e-4aa7-b3f2-61f5e0b1c84d tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:32:32.791950 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-accf3183-6a5e-4aa7-b3f2-61f5e0b1c84d tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: e8d23cb3-2f39-4b00-ae9d-006e392a5940] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:32:32.800865 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-accf3183-6a5e-4aa7-b3f2-61f5e0b1c84d tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:32.801496 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-accf3183-6a5e-4aa7-b3f2-61f5e0b1c84d tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:32.802093 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-accf3183-6a5e-4aa7-b3f2-61f5e0b1c84d tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:32.805211 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-accf3183-6a5e-4aa7-b3f2-61f5e0b1c84d tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:32.805845 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-accf3183-6a5e-4aa7-b3f2-61f5e0b1c84d tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:32.806909 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-accf3183-6a5e-4aa7-b3f2-61f5e0b1c84d tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:32.810538 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-cef766e0-9ab5-4d90-bcc9-3796a1dff55b tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:32:32.811544 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-cef766e0-9ab5-4d90-bcc9-3796a1dff55b tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] [instance: c453c474-644e-4e46-9d23-b2b87716f5d7] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:32:32.822717 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cef766e0-9ab5-4d90-bcc9-3796a1dff55b tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:32.823444 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cef766e0-9ab5-4d90-bcc9-3796a1dff55b tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:32.824761 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cef766e0-9ab5-4d90-bcc9-3796a1dff55b tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:32.825680 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cef766e0-9ab5-4d90-bcc9-3796a1dff55b tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:32.826280 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cef766e0-9ab5-4d90-bcc9-3796a1dff55b tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:32.826866 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cef766e0-9ab5-4d90-bcc9-3796a1dff55b tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:33.424743 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-accf3183-6a5e-4aa7-b3f2-61f5e0b1c84d tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d86f09c6304121be2021cb5c15e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ab544d0b547919794e3efb49ba0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:32:33.436708 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-accf3183-6a5e-4aa7-b3f2-61f5e0b1c84d tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940" status: 200 len: 1322 microversion: 2.1 time: 0.651511 Sep 09 16:32:33.438626 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 53/107] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:32:32 2022] GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940 => generated 1322 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:32:33.471298 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-cef766e0-9ab5-4d90-bcc9-3796a1dff55b tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c0721dc18343b18993ff5af098841d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17967a941be4a04bbc180e2cf3a7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:32:33.480557 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-cef766e0-9ab5-4d90-bcc9-3796a1dff55b tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] 10.222.0.23 "GET /compute/v2.1/servers/c453c474-644e-4e46-9d23-b2b87716f5d7" status: 200 len: 1366 microversion: 2.1 time: 0.674721 Sep 09 16:32:33.481901 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 55/108] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:32:32 2022] GET /compute/v2.1/servers/c453c474-644e-4e46-9d23-b2b87716f5d7 => generated 1366 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:32:33.489161 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-fdaade5c-3577-4e27-9bd8-6c32898153b3 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:32:33.491673 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-fdaade5c-3577-4e27-9bd8-6c32898153b3 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] [instance: 15d68c64-0569-4afa-a718-bc0e0c2cba3e] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:32:33.499147 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-fdaade5c-3577-4e27-9bd8-6c32898153b3 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:33.500015 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-fdaade5c-3577-4e27-9bd8-6c32898153b3 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:33.500474 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-fdaade5c-3577-4e27-9bd8-6c32898153b3 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:33.501220 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-fdaade5c-3577-4e27-9bd8-6c32898153b3 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:33.501860 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-fdaade5c-3577-4e27-9bd8-6c32898153b3 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:33.502286 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-fdaade5c-3577-4e27-9bd8-6c32898153b3 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:33.508132 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-8a8d7c23-8f4d-4b4e-8c8f-11731df7a4ee tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:32:33.508939 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-8a8d7c23-8f4d-4b4e-8c8f-11731df7a4ee tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] [instance: 9e761961-9c74-444c-bb4b-0b2f82a9d698] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:32:33.518158 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8a8d7c23-8f4d-4b4e-8c8f-11731df7a4ee tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:33.518158 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8a8d7c23-8f4d-4b4e-8c8f-11731df7a4ee tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:33.518158 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8a8d7c23-8f4d-4b4e-8c8f-11731df7a4ee tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:33.518727 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8a8d7c23-8f4d-4b4e-8c8f-11731df7a4ee tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:33.519195 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8a8d7c23-8f4d-4b4e-8c8f-11731df7a4ee tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:33.519616 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8a8d7c23-8f4d-4b4e-8c8f-11731df7a4ee tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:33.740268 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-fdaade5c-3577-4e27-9bd8-6c32898153b3 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce1cd9c19584549b794df8e487abf00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f227ee89ce84dec84410a1db9b479fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:32:33.748015 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-8a8d7c23-8f4d-4b4e-8c8f-11731df7a4ee tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd095ed814b9e47e08d6b5a4fd2901c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f2e0c002343d88ae25dc7bfb2fe10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:32:33.749694 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-fdaade5c-3577-4e27-9bd8-6c32898153b3 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] 10.222.0.23 "GET /compute/v2.1/servers/15d68c64-0569-4afa-a718-bc0e0c2cba3e" status: 200 len: 1313 microversion: 2.1 time: 0.264529 Sep 09 16:32:33.750284 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 54/109] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:32:33 2022] GET /compute/v2.1/servers/15d68c64-0569-4afa-a718-bc0e0c2cba3e => generated 1313 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:32:33.756863 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-8a8d7c23-8f4d-4b4e-8c8f-11731df7a4ee tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] 10.222.0.23 "GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698" status: 200 len: 1362 microversion: 2.1 time: 0.253739 Sep 09 16:32:33.757614 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 56/110] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:32:33 2022] GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698 => generated 1362 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:32:34.463688 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-a44ad3e2-cd37-418e-80e5-a983668c6b5e tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:32:34.464972 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-a44ad3e2-cd37-418e-80e5-a983668c6b5e tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: e8d23cb3-2f39-4b00-ae9d-006e392a5940] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:32:34.474188 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG dbcounter [-] [127196] Writing DB stats nova_cell0:SELECT=2 {{(pid=127196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:32:34.479642 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-a44ad3e2-cd37-418e-80e5-a983668c6b5e tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:34.483335 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-a44ad3e2-cd37-418e-80e5-a983668c6b5e tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:34.484292 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-a44ad3e2-cd37-418e-80e5-a983668c6b5e tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:34.485507 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-a44ad3e2-cd37-418e-80e5-a983668c6b5e tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:34.488394 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-a44ad3e2-cd37-418e-80e5-a983668c6b5e tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:34.489463 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-a44ad3e2-cd37-418e-80e5-a983668c6b5e tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:34.503810 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell0:SELECT=2 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:32:34.509672 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-41927457-39a1-4e50-bb2e-0760faf7236e tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:32:34.510800 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-41927457-39a1-4e50-bb2e-0760faf7236e tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] [instance: c453c474-644e-4e46-9d23-b2b87716f5d7] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:32:34.522968 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-41927457-39a1-4e50-bb2e-0760faf7236e tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:34.524413 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-41927457-39a1-4e50-bb2e-0760faf7236e tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:34.524757 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-41927457-39a1-4e50-bb2e-0760faf7236e tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:34.528143 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-41927457-39a1-4e50-bb2e-0760faf7236e tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:34.528632 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-41927457-39a1-4e50-bb2e-0760faf7236e tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:34.530649 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-41927457-39a1-4e50-bb2e-0760faf7236e tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:34.756551 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-a44ad3e2-cd37-418e-80e5-a983668c6b5e tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d86f09c6304121be2021cb5c15e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ab544d0b547919794e3efb49ba0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:32:34.773003 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-a44ad3e2-cd37-418e-80e5-a983668c6b5e tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940" status: 200 len: 1322 microversion: 2.1 time: 0.313978 Sep 09 16:32:34.773864 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 55/111] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:32:34 2022] GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940 => generated 1322 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:32:34.786915 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-31faebb4-2045-41c5-bb2b-49d8c6f6f4b6 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:32:34.787423 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-31faebb4-2045-41c5-bb2b-49d8c6f6f4b6 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] [instance: 15d68c64-0569-4afa-a718-bc0e0c2cba3e] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:32:34.804489 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-31faebb4-2045-41c5-bb2b-49d8c6f6f4b6 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:34.804965 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-31faebb4-2045-41c5-bb2b-49d8c6f6f4b6 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:34.805404 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-31faebb4-2045-41c5-bb2b-49d8c6f6f4b6 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:34.806105 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-31faebb4-2045-41c5-bb2b-49d8c6f6f4b6 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:34.806581 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-31faebb4-2045-41c5-bb2b-49d8c6f6f4b6 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:34.806994 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-31faebb4-2045-41c5-bb2b-49d8c6f6f4b6 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:34.872680 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-41927457-39a1-4e50-bb2e-0760faf7236e tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c0721dc18343b18993ff5af098841d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17967a941be4a04bbc180e2cf3a7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:32:34.882783 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-41927457-39a1-4e50-bb2e-0760faf7236e tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] 10.222.0.23 "GET /compute/v2.1/servers/c453c474-644e-4e46-9d23-b2b87716f5d7" status: 200 len: 1366 microversion: 2.1 time: 0.379910 Sep 09 16:32:34.884142 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 57/112] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:32:34 2022] GET /compute/v2.1/servers/c453c474-644e-4e46-9d23-b2b87716f5d7 => generated 1366 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 16:32:34.890680 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-b3b047d5-5100-4b40-b34d-71d989798446 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:32:34.891579 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-b3b047d5-5100-4b40-b34d-71d989798446 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] [instance: 9e761961-9c74-444c-bb4b-0b2f82a9d698] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:32:34.899068 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b3b047d5-5100-4b40-b34d-71d989798446 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:34.899920 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b3b047d5-5100-4b40-b34d-71d989798446 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:34.900403 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b3b047d5-5100-4b40-b34d-71d989798446 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:34.901231 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b3b047d5-5100-4b40-b34d-71d989798446 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:34.901978 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b3b047d5-5100-4b40-b34d-71d989798446 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:34.902704 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b3b047d5-5100-4b40-b34d-71d989798446 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:35.257241 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-b3b047d5-5100-4b40-b34d-71d989798446 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd095ed814b9e47e08d6b5a4fd2901c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f2e0c002343d88ae25dc7bfb2fe10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:32:35.269281 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-b3b047d5-5100-4b40-b34d-71d989798446 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] 10.222.0.23 "GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698" status: 200 len: 1362 microversion: 2.1 time: 0.383752 Sep 09 16:32:35.269867 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 58/113] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:32:34 2022] GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698 => generated 1362 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:32:35.436975 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-31faebb4-2045-41c5-bb2b-49d8c6f6f4b6 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce1cd9c19584549b794df8e487abf00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f227ee89ce84dec84410a1db9b479fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:32:35.448168 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-31faebb4-2045-41c5-bb2b-49d8c6f6f4b6 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] 10.222.0.23 "GET /compute/v2.1/servers/15d68c64-0569-4afa-a718-bc0e0c2cba3e" status: 200 len: 1313 microversion: 2.1 time: 0.673105 Sep 09 16:32:35.463223 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 56/114] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:32:34 2022] GET /compute/v2.1/servers/15d68c64-0569-4afa-a718-bc0e0c2cba3e => generated 1313 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:32:35.798210 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-8d10c59e-ea67-49a1-a8e8-86054a9bc207 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:32:35.800006 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-8d10c59e-ea67-49a1-a8e8-86054a9bc207 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: e8d23cb3-2f39-4b00-ae9d-006e392a5940] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:32:35.806587 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8d10c59e-ea67-49a1-a8e8-86054a9bc207 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:35.807652 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8d10c59e-ea67-49a1-a8e8-86054a9bc207 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:35.808286 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8d10c59e-ea67-49a1-a8e8-86054a9bc207 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:35.809226 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8d10c59e-ea67-49a1-a8e8-86054a9bc207 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:35.809872 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8d10c59e-ea67-49a1-a8e8-86054a9bc207 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:35.810554 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8d10c59e-ea67-49a1-a8e8-86054a9bc207 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:35.909483 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-6a909a02-a3be-46f1-8098-f22f2ad8fdcb tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:32:35.911089 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-6a909a02-a3be-46f1-8098-f22f2ad8fdcb tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] [instance: c453c474-644e-4e46-9d23-b2b87716f5d7] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:32:35.920060 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-6a909a02-a3be-46f1-8098-f22f2ad8fdcb tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:35.920984 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-6a909a02-a3be-46f1-8098-f22f2ad8fdcb tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:35.922940 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-6a909a02-a3be-46f1-8098-f22f2ad8fdcb tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:35.925155 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-6a909a02-a3be-46f1-8098-f22f2ad8fdcb tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:35.926511 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-6a909a02-a3be-46f1-8098-f22f2ad8fdcb tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:35.927307 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-6a909a02-a3be-46f1-8098-f22f2ad8fdcb tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:36.006662 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-8d10c59e-ea67-49a1-a8e8-86054a9bc207 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d86f09c6304121be2021cb5c15e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ab544d0b547919794e3efb49ba0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:32:36.022583 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-8d10c59e-ea67-49a1-a8e8-86054a9bc207 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940" status: 200 len: 1322 microversion: 2.1 time: 0.227355 Sep 09 16:32:36.022583 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 59/115] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:32:35 2022] GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940 => generated 1322 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:32:36.141673 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-6a909a02-a3be-46f1-8098-f22f2ad8fdcb tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c0721dc18343b18993ff5af098841d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17967a941be4a04bbc180e2cf3a7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:32:36.151518 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-6a909a02-a3be-46f1-8098-f22f2ad8fdcb tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] 10.222.0.23 "GET /compute/v2.1/servers/c453c474-644e-4e46-9d23-b2b87716f5d7" status: 200 len: 1366 microversion: 2.1 time: 0.248168 Sep 09 16:32:36.152269 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 57/116] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:32:35 2022] GET /compute/v2.1/servers/c453c474-644e-4e46-9d23-b2b87716f5d7 => generated 1366 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 16:32:36.295118 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-3cba2cb9-92c7-463a-a89c-723143c9da4c tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:32:36.295767 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-3cba2cb9-92c7-463a-a89c-723143c9da4c tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] [instance: 9e761961-9c74-444c-bb4b-0b2f82a9d698] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:32:36.302237 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3cba2cb9-92c7-463a-a89c-723143c9da4c tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:36.302758 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3cba2cb9-92c7-463a-a89c-723143c9da4c tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:36.303185 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3cba2cb9-92c7-463a-a89c-723143c9da4c tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:36.304039 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3cba2cb9-92c7-463a-a89c-723143c9da4c tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:36.304486 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3cba2cb9-92c7-463a-a89c-723143c9da4c tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:36.305053 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3cba2cb9-92c7-463a-a89c-723143c9da4c tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:36.450316 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-3cba2cb9-92c7-463a-a89c-723143c9da4c tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd095ed814b9e47e08d6b5a4fd2901c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f2e0c002343d88ae25dc7bfb2fe10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:32:36.473255 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-3cba2cb9-92c7-463a-a89c-723143c9da4c tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] 10.222.0.23 "GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698" status: 200 len: 1362 microversion: 2.1 time: 0.181995 Sep 09 16:32:36.475238 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 60/117] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:32:36 2022] GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698 => generated 1362 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:32:36.475909 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-a0ee7f9a-8ad0-4ffd-b3cd-a4691b3fd55e tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:32:36.476695 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-a0ee7f9a-8ad0-4ffd-b3cd-a4691b3fd55e tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] [instance: 15d68c64-0569-4afa-a718-bc0e0c2cba3e] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:32:36.484386 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-a0ee7f9a-8ad0-4ffd-b3cd-a4691b3fd55e tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:36.485046 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-a0ee7f9a-8ad0-4ffd-b3cd-a4691b3fd55e tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:36.485618 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-a0ee7f9a-8ad0-4ffd-b3cd-a4691b3fd55e tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:36.486763 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-a0ee7f9a-8ad0-4ffd-b3cd-a4691b3fd55e tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:36.487810 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-a0ee7f9a-8ad0-4ffd-b3cd-a4691b3fd55e tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:36.488369 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-a0ee7f9a-8ad0-4ffd-b3cd-a4691b3fd55e tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:36.643347 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-a0ee7f9a-8ad0-4ffd-b3cd-a4691b3fd55e tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce1cd9c19584549b794df8e487abf00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f227ee89ce84dec84410a1db9b479fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:32:36.653280 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-a0ee7f9a-8ad0-4ffd-b3cd-a4691b3fd55e tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] 10.222.0.23 "GET /compute/v2.1/servers/15d68c64-0569-4afa-a718-bc0e0c2cba3e" status: 200 len: 1313 microversion: 2.1 time: 0.184976 Sep 09 16:32:36.654041 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 58/118] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:32:36 2022] GET /compute/v2.1/servers/15d68c64-0569-4afa-a718-bc0e0c2cba3e => generated 1313 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 16:32:37.045691 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-00929906-92a6-4b75-b67a-db6d1b658c5a tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:32:37.046681 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-00929906-92a6-4b75-b67a-db6d1b658c5a tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: e8d23cb3-2f39-4b00-ae9d-006e392a5940] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:32:37.053209 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-00929906-92a6-4b75-b67a-db6d1b658c5a tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:37.053905 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-00929906-92a6-4b75-b67a-db6d1b658c5a tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:37.054577 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-00929906-92a6-4b75-b67a-db6d1b658c5a tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:37.055555 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-00929906-92a6-4b75-b67a-db6d1b658c5a tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:37.056130 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-00929906-92a6-4b75-b67a-db6d1b658c5a tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:37.056935 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-00929906-92a6-4b75-b67a-db6d1b658c5a tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:37.179261 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-dc7ceb92-da82-48d7-9669-3ba9ee02416b tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:32:37.181776 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-dc7ceb92-da82-48d7-9669-3ba9ee02416b tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] [instance: c453c474-644e-4e46-9d23-b2b87716f5d7] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:32:37.191653 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-dc7ceb92-da82-48d7-9669-3ba9ee02416b tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:37.192705 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-dc7ceb92-da82-48d7-9669-3ba9ee02416b tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:37.197623 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-dc7ceb92-da82-48d7-9669-3ba9ee02416b tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:37.198660 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-dc7ceb92-da82-48d7-9669-3ba9ee02416b tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:37.199603 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-dc7ceb92-da82-48d7-9669-3ba9ee02416b tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:37.200292 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-dc7ceb92-da82-48d7-9669-3ba9ee02416b tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:37.287045 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-00929906-92a6-4b75-b67a-db6d1b658c5a tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d86f09c6304121be2021cb5c15e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ab544d0b547919794e3efb49ba0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:32:37.301239 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-00929906-92a6-4b75-b67a-db6d1b658c5a tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940" status: 200 len: 1322 microversion: 2.1 time: 0.260338 Sep 09 16:32:37.311120 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 61/119] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:32:37 2022] GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940 => generated 1322 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:32:37.371442 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-dc7ceb92-da82-48d7-9669-3ba9ee02416b tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c0721dc18343b18993ff5af098841d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17967a941be4a04bbc180e2cf3a7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:32:37.385710 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-dc7ceb92-da82-48d7-9669-3ba9ee02416b tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] 10.222.0.23 "GET /compute/v2.1/servers/c453c474-644e-4e46-9d23-b2b87716f5d7" status: 200 len: 1366 microversion: 2.1 time: 0.215274 Sep 09 16:32:37.398977 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 59/120] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:32:37 2022] GET /compute/v2.1/servers/c453c474-644e-4e46-9d23-b2b87716f5d7 => generated 1366 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 16:32:37.497242 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-aca1236a-b073-4020-87f4-edc81d7be447 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:32:37.497893 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-aca1236a-b073-4020-87f4-edc81d7be447 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] [instance: 9e761961-9c74-444c-bb4b-0b2f82a9d698] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:32:37.508042 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-aca1236a-b073-4020-87f4-edc81d7be447 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:37.508590 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-aca1236a-b073-4020-87f4-edc81d7be447 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:37.509143 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-aca1236a-b073-4020-87f4-edc81d7be447 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:37.509911 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-aca1236a-b073-4020-87f4-edc81d7be447 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:37.514055 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-aca1236a-b073-4020-87f4-edc81d7be447 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:37.515063 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-aca1236a-b073-4020-87f4-edc81d7be447 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:37.676517 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-3ca2ea54-91fa-4f0f-b377-2f7f54492c30 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:32:37.677617 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-3ca2ea54-91fa-4f0f-b377-2f7f54492c30 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] [instance: 15d68c64-0569-4afa-a718-bc0e0c2cba3e] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:32:37.685896 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-3ca2ea54-91fa-4f0f-b377-2f7f54492c30 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:37.686763 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-3ca2ea54-91fa-4f0f-b377-2f7f54492c30 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:37.687430 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-3ca2ea54-91fa-4f0f-b377-2f7f54492c30 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:37.688271 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-3ca2ea54-91fa-4f0f-b377-2f7f54492c30 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:37.689019 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-3ca2ea54-91fa-4f0f-b377-2f7f54492c30 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:37.689573 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-3ca2ea54-91fa-4f0f-b377-2f7f54492c30 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:37.751331 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-aca1236a-b073-4020-87f4-edc81d7be447 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd095ed814b9e47e08d6b5a4fd2901c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f2e0c002343d88ae25dc7bfb2fe10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:32:37.759545 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-aca1236a-b073-4020-87f4-edc81d7be447 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] 10.222.0.23 "GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698" status: 200 len: 1362 microversion: 2.1 time: 0.266163 Sep 09 16:32:37.766303 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 62/121] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:32:37 2022] GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698 => generated 1362 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:32:37.868088 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-3ca2ea54-91fa-4f0f-b377-2f7f54492c30 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce1cd9c19584549b794df8e487abf00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f227ee89ce84dec84410a1db9b479fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:32:37.875907 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-3ca2ea54-91fa-4f0f-b377-2f7f54492c30 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] 10.222.0.23 "GET /compute/v2.1/servers/15d68c64-0569-4afa-a718-bc0e0c2cba3e" status: 200 len: 1313 microversion: 2.1 time: 0.204265 Sep 09 16:32:37.876482 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 60/122] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:32:37 2022] GET /compute/v2.1/servers/15d68c64-0569-4afa-a718-bc0e0c2cba3e => generated 1313 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 16:32:38.330287 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-98113d8c-17d1-4f09-a0e1-bcf3cd85608a tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:32:38.331548 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-98113d8c-17d1-4f09-a0e1-bcf3cd85608a tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: e8d23cb3-2f39-4b00-ae9d-006e392a5940] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:32:38.344405 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-98113d8c-17d1-4f09-a0e1-bcf3cd85608a tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:38.346138 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-98113d8c-17d1-4f09-a0e1-bcf3cd85608a tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:38.347110 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-98113d8c-17d1-4f09-a0e1-bcf3cd85608a tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:38.348529 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-98113d8c-17d1-4f09-a0e1-bcf3cd85608a tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:38.349482 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-98113d8c-17d1-4f09-a0e1-bcf3cd85608a tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:38.350714 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-98113d8c-17d1-4f09-a0e1-bcf3cd85608a tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:38.410328 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-40efb02a-cf84-411d-8c33-4232b6d2c7cc tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:32:38.412219 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-40efb02a-cf84-411d-8c33-4232b6d2c7cc tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] [instance: c453c474-644e-4e46-9d23-b2b87716f5d7] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:32:38.420063 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-40efb02a-cf84-411d-8c33-4232b6d2c7cc tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:38.420771 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-40efb02a-cf84-411d-8c33-4232b6d2c7cc tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:38.421427 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-40efb02a-cf84-411d-8c33-4232b6d2c7cc tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:38.422277 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-40efb02a-cf84-411d-8c33-4232b6d2c7cc tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:38.424865 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-40efb02a-cf84-411d-8c33-4232b6d2c7cc tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:38.425457 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-40efb02a-cf84-411d-8c33-4232b6d2c7cc tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:38.607592 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-98113d8c-17d1-4f09-a0e1-bcf3cd85608a tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d86f09c6304121be2021cb5c15e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ab544d0b547919794e3efb49ba0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:32:38.617043 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-98113d8c-17d1-4f09-a0e1-bcf3cd85608a tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940" status: 200 len: 1322 microversion: 2.1 time: 0.293765 Sep 09 16:32:38.622184 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 63/123] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:32:38 2022] GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940 => generated 1322 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 16:32:38.673784 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-40efb02a-cf84-411d-8c33-4232b6d2c7cc tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c0721dc18343b18993ff5af098841d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17967a941be4a04bbc180e2cf3a7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:32:38.685453 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-40efb02a-cf84-411d-8c33-4232b6d2c7cc tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] 10.222.0.23 "GET /compute/v2.1/servers/c453c474-644e-4e46-9d23-b2b87716f5d7" status: 200 len: 1366 microversion: 2.1 time: 0.280353 Sep 09 16:32:38.695482 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 61/124] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:32:38 2022] GET /compute/v2.1/servers/c453c474-644e-4e46-9d23-b2b87716f5d7 => generated 1366 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 16:32:38.787903 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-59e5b613-46a9-41d3-abbb-aacaf800f2a1 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:32:38.788503 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-59e5b613-46a9-41d3-abbb-aacaf800f2a1 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] [instance: 9e761961-9c74-444c-bb4b-0b2f82a9d698] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:32:38.802871 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-59e5b613-46a9-41d3-abbb-aacaf800f2a1 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:38.803525 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-59e5b613-46a9-41d3-abbb-aacaf800f2a1 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:38.804094 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-59e5b613-46a9-41d3-abbb-aacaf800f2a1 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:38.804928 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-59e5b613-46a9-41d3-abbb-aacaf800f2a1 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:38.805511 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-59e5b613-46a9-41d3-abbb-aacaf800f2a1 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:38.806086 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-59e5b613-46a9-41d3-abbb-aacaf800f2a1 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:38.902349 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-2f344459-60cf-4e3a-894d-3ed287a3eda1 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:32:38.902797 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-2f344459-60cf-4e3a-894d-3ed287a3eda1 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] [instance: 15d68c64-0569-4afa-a718-bc0e0c2cba3e] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:32:38.915506 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-2f344459-60cf-4e3a-894d-3ed287a3eda1 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:38.917946 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-2f344459-60cf-4e3a-894d-3ed287a3eda1 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:38.919097 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-2f344459-60cf-4e3a-894d-3ed287a3eda1 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:38.922107 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-2f344459-60cf-4e3a-894d-3ed287a3eda1 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:38.924165 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-2f344459-60cf-4e3a-894d-3ed287a3eda1 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:38.924610 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-2f344459-60cf-4e3a-894d-3ed287a3eda1 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:39.085104 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-59e5b613-46a9-41d3-abbb-aacaf800f2a1 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd095ed814b9e47e08d6b5a4fd2901c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f2e0c002343d88ae25dc7bfb2fe10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:32:39.094867 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-59e5b613-46a9-41d3-abbb-aacaf800f2a1 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] 10.222.0.23 "GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698" status: 200 len: 1362 microversion: 2.1 time: 0.310728 Sep 09 16:32:39.099011 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 64/125] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:32:38 2022] GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698 => generated 1362 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:32:39.276758 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-2f344459-60cf-4e3a-894d-3ed287a3eda1 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce1cd9c19584549b794df8e487abf00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f227ee89ce84dec84410a1db9b479fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:32:39.296983 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-2f344459-60cf-4e3a-894d-3ed287a3eda1 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] 10.222.0.23 "GET /compute/v2.1/servers/15d68c64-0569-4afa-a718-bc0e0c2cba3e" status: 200 len: 1313 microversion: 2.1 time: 0.400119 Sep 09 16:32:39.300906 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 62/126] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:32:38 2022] GET /compute/v2.1/servers/15d68c64-0569-4afa-a718-bc0e0c2cba3e => generated 1313 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:32:39.647957 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-2d74f97e-a44b-454e-9a3f-4c14f6414c22 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:32:39.648513 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-2d74f97e-a44b-454e-9a3f-4c14f6414c22 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: e8d23cb3-2f39-4b00-ae9d-006e392a5940] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:32:39.661190 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2d74f97e-a44b-454e-9a3f-4c14f6414c22 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:39.661982 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2d74f97e-a44b-454e-9a3f-4c14f6414c22 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:39.665174 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2d74f97e-a44b-454e-9a3f-4c14f6414c22 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:39.665974 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2d74f97e-a44b-454e-9a3f-4c14f6414c22 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:39.666441 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2d74f97e-a44b-454e-9a3f-4c14f6414c22 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:39.673023 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2d74f97e-a44b-454e-9a3f-4c14f6414c22 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:39.712931 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-dfee9e79-199f-4092-af95-71c94884d511 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:32:39.713630 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-dfee9e79-199f-4092-af95-71c94884d511 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] [instance: c453c474-644e-4e46-9d23-b2b87716f5d7] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:32:39.724148 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-dfee9e79-199f-4092-af95-71c94884d511 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:39.726561 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-dfee9e79-199f-4092-af95-71c94884d511 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:39.728079 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-dfee9e79-199f-4092-af95-71c94884d511 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:39.730586 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-dfee9e79-199f-4092-af95-71c94884d511 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:39.731215 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-dfee9e79-199f-4092-af95-71c94884d511 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:39.735118 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-dfee9e79-199f-4092-af95-71c94884d511 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:40.520105 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-dfee9e79-199f-4092-af95-71c94884d511 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c0721dc18343b18993ff5af098841d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17967a941be4a04bbc180e2cf3a7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:32:40.535415 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG dbcounter [-] [127196] Writing DB stats nova_cell1:SELECT=100 {{(pid=127196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:32:40.539564 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-dfee9e79-199f-4092-af95-71c94884d511 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] 10.222.0.23 "GET /compute/v2.1/servers/c453c474-644e-4e46-9d23-b2b87716f5d7" status: 200 len: 1366 microversion: 2.1 time: 0.832931 Sep 09 16:32:40.546184 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-2d74f97e-a44b-454e-9a3f-4c14f6414c22 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d86f09c6304121be2021cb5c15e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ab544d0b547919794e3efb49ba0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:32:40.547235 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 63/127] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:32:39 2022] GET /compute/v2.1/servers/c453c474-644e-4e46-9d23-b2b87716f5d7 => generated 1366 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:32:40.560116 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-2d74f97e-a44b-454e-9a3f-4c14f6414c22 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940" status: 200 len: 1322 microversion: 2.1 time: 0.916603 Sep 09 16:32:40.560719 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 65/128] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:32:39 2022] GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940 => generated 1322 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:32:40.600348 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-0bf41a14-aab5-4dcb-9c43-ed8509307580 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:32:40.603430 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-0bf41a14-aab5-4dcb-9c43-ed8509307580 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] [instance: 9e761961-9c74-444c-bb4b-0b2f82a9d698] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:32:40.617621 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0bf41a14-aab5-4dcb-9c43-ed8509307580 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:40.618206 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0bf41a14-aab5-4dcb-9c43-ed8509307580 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:40.618756 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0bf41a14-aab5-4dcb-9c43-ed8509307580 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:40.621391 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0bf41a14-aab5-4dcb-9c43-ed8509307580 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:40.621839 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0bf41a14-aab5-4dcb-9c43-ed8509307580 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:40.622268 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0bf41a14-aab5-4dcb-9c43-ed8509307580 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:40.841346 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [req-f2aeccbc-07d0-460b-a020-46854ce344b9 req-e6bcd38d-665e-4b96-af55-460dfcd5fbac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c453c474-644e-4e46-9d23-b2b87716f5d7", "name": "network-vif-plugged", "status": "completed", "tag": "4976ea2e-5f69-46bc-9cfb-142523115ea4"}]} {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:32:40.850938 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [req-f2aeccbc-07d0-460b-a020-46854ce344b9 req-e6bcd38d-665e-4b96-af55-460dfcd5fbac service nova] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:40.851845 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [req-f2aeccbc-07d0-460b-a020-46854ce344b9 req-e6bcd38d-665e-4b96-af55-460dfcd5fbac service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:40.852438 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [req-f2aeccbc-07d0-460b-a020-46854ce344b9 req-e6bcd38d-665e-4b96-af55-460dfcd5fbac service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:40.864997 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.compute.server_external_events [req-f2aeccbc-07d0-460b-a020-46854ce344b9 req-e6bcd38d-665e-4b96-af55-460dfcd5fbac service nova] Creating event network-vif-plugged:4976ea2e-5f69-46bc-9cfb-142523115ea4 for instance c453c474-644e-4e46-9d23-b2b87716f5d7 on hv-cinder-83124 Sep 09 16:32:40.870799 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [req-f2aeccbc-07d0-460b-a020-46854ce344b9 req-e6bcd38d-665e-4b96-af55-460dfcd5fbac service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.322297 Sep 09 16:32:40.876537 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 64/129] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Sep 9 16:32:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:32:40.892849 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-a0687665-b710-4aa8-8eae-aeb8ef907d97 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:32:40.894795 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-a0687665-b710-4aa8-8eae-aeb8ef907d97 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] [instance: 15d68c64-0569-4afa-a718-bc0e0c2cba3e] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:32:40.914403 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-a0687665-b710-4aa8-8eae-aeb8ef907d97 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:40.915778 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-a0687665-b710-4aa8-8eae-aeb8ef907d97 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:40.916398 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-a0687665-b710-4aa8-8eae-aeb8ef907d97 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:40.917287 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-a0687665-b710-4aa8-8eae-aeb8ef907d97 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:40.917939 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-a0687665-b710-4aa8-8eae-aeb8ef907d97 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:40.918714 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-a0687665-b710-4aa8-8eae-aeb8ef907d97 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:40.952752 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-0bf41a14-aab5-4dcb-9c43-ed8509307580 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd095ed814b9e47e08d6b5a4fd2901c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f2e0c002343d88ae25dc7bfb2fe10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:32:40.969916 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-0bf41a14-aab5-4dcb-9c43-ed8509307580 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] 10.222.0.23 "GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698" status: 200 len: 1362 microversion: 2.1 time: 0.380289 Sep 09 16:32:40.978318 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 66/130] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:32:40 2022] GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698 => generated 1362 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:32:41.212004 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-a0687665-b710-4aa8-8eae-aeb8ef907d97 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce1cd9c19584549b794df8e487abf00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f227ee89ce84dec84410a1db9b479fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:32:41.224986 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-a0687665-b710-4aa8-8eae-aeb8ef907d97 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] 10.222.0.23 "GET /compute/v2.1/servers/15d68c64-0569-4afa-a718-bc0e0c2cba3e" status: 200 len: 1313 microversion: 2.1 time: 0.347023 Sep 09 16:32:41.225983 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 65/131] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:32:40 2022] GET /compute/v2.1/servers/15d68c64-0569-4afa-a718-bc0e0c2cba3e => generated 1313 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:32:41.565001 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-3c199e58-7507-49d0-938f-a0f354e5f3c0 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:32:41.566132 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-3c199e58-7507-49d0-938f-a0f354e5f3c0 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] [instance: c453c474-644e-4e46-9d23-b2b87716f5d7] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:32:41.575294 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3c199e58-7507-49d0-938f-a0f354e5f3c0 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:41.575780 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3c199e58-7507-49d0-938f-a0f354e5f3c0 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:41.576850 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3c199e58-7507-49d0-938f-a0f354e5f3c0 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:41.578287 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3c199e58-7507-49d0-938f-a0f354e5f3c0 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:41.578946 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3c199e58-7507-49d0-938f-a0f354e5f3c0 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:41.582055 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3c199e58-7507-49d0-938f-a0f354e5f3c0 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:41.583589 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-bff2ed08-b849-4a47-81e6-51af881efbe8 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:32:41.584208 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-bff2ed08-b849-4a47-81e6-51af881efbe8 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: e8d23cb3-2f39-4b00-ae9d-006e392a5940] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:32:41.598833 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-bff2ed08-b849-4a47-81e6-51af881efbe8 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:41.598833 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-bff2ed08-b849-4a47-81e6-51af881efbe8 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:41.598833 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-bff2ed08-b849-4a47-81e6-51af881efbe8 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:41.598833 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-bff2ed08-b849-4a47-81e6-51af881efbe8 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:41.599219 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-bff2ed08-b849-4a47-81e6-51af881efbe8 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:41.599219 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-bff2ed08-b849-4a47-81e6-51af881efbe8 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:41.879184 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-bff2ed08-b849-4a47-81e6-51af881efbe8 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d86f09c6304121be2021cb5c15e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ab544d0b547919794e3efb49ba0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:32:41.890827 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-bff2ed08-b849-4a47-81e6-51af881efbe8 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940" status: 200 len: 1322 microversion: 2.1 time: 0.309422 Sep 09 16:32:41.891705 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-3c199e58-7507-49d0-938f-a0f354e5f3c0 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c0721dc18343b18993ff5af098841d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17967a941be4a04bbc180e2cf3a7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:32:41.891976 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 66/132] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:32:41 2022] GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940 => generated 1322 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:32:41.903695 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-3c199e58-7507-49d0-938f-a0f354e5f3c0 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] 10.222.0.23 "GET /compute/v2.1/servers/c453c474-644e-4e46-9d23-b2b87716f5d7" status: 200 len: 1366 microversion: 2.1 time: 0.342420 Sep 09 16:32:41.918778 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 67/133] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:32:41 2022] GET /compute/v2.1/servers/c453c474-644e-4e46-9d23-b2b87716f5d7 => generated 1366 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:32:41.992851 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-e33acb8a-20ed-4a65-8f81-ea512774b656 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:32:41.994593 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-e33acb8a-20ed-4a65-8f81-ea512774b656 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] [instance: 9e761961-9c74-444c-bb4b-0b2f82a9d698] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:32:42.000706 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e33acb8a-20ed-4a65-8f81-ea512774b656 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:42.001182 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e33acb8a-20ed-4a65-8f81-ea512774b656 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:42.001841 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e33acb8a-20ed-4a65-8f81-ea512774b656 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:42.002561 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e33acb8a-20ed-4a65-8f81-ea512774b656 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:42.003229 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e33acb8a-20ed-4a65-8f81-ea512774b656 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:42.003862 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e33acb8a-20ed-4a65-8f81-ea512774b656 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:42.166343 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-e33acb8a-20ed-4a65-8f81-ea512774b656 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd095ed814b9e47e08d6b5a4fd2901c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f2e0c002343d88ae25dc7bfb2fe10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:32:42.176766 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-e33acb8a-20ed-4a65-8f81-ea512774b656 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] 10.222.0.23 "GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698" status: 200 len: 1362 microversion: 2.1 time: 0.187876 Sep 09 16:32:42.177741 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 67/134] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:32:41 2022] GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698 => generated 1362 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:32:42.248727 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-7622c42d-19f4-4688-a660-7c32b00c905a tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:32:42.250958 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-7622c42d-19f4-4688-a660-7c32b00c905a tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] [instance: 15d68c64-0569-4afa-a718-bc0e0c2cba3e] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:32:42.262299 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7622c42d-19f4-4688-a660-7c32b00c905a tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:42.263738 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7622c42d-19f4-4688-a660-7c32b00c905a tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:42.264386 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7622c42d-19f4-4688-a660-7c32b00c905a tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:42.265339 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7622c42d-19f4-4688-a660-7c32b00c905a tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:42.265994 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7622c42d-19f4-4688-a660-7c32b00c905a tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:42.266980 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7622c42d-19f4-4688-a660-7c32b00c905a tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:42.450175 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-7622c42d-19f4-4688-a660-7c32b00c905a tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce1cd9c19584549b794df8e487abf00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f227ee89ce84dec84410a1db9b479fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:32:42.453929 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell1:SELECT=100 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:32:42.459518 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-7622c42d-19f4-4688-a660-7c32b00c905a tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] 10.222.0.23 "GET /compute/v2.1/servers/15d68c64-0569-4afa-a718-bc0e0c2cba3e" status: 200 len: 1313 microversion: 2.1 time: 0.215063 Sep 09 16:32:42.460100 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 68/135] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:32:42 2022] GET /compute/v2.1/servers/15d68c64-0569-4afa-a718-bc0e0c2cba3e => generated 1313 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:32:42.886772 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [req-b9b21b76-be41-4321-a975-e9fbaac38014 req-ab88a45b-de22-4390-8975-f4b85f3eeed7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc41312a-3de8-4584-9bcf-a1f31b952025", "name": "network-vif-plugged", "status": "completed", "tag": "fe97fa1b-e830-46b1-ba10-d58f1d1269f2"}, {"server_uuid": "e8d23cb3-2f39-4b00-ae9d-006e392a5940", "name": "network-vif-plugged", "status": "completed", "tag": "98eca583-6399-4702-a0d5-6321d1da9439"}]} {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:32:42.897844 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [req-b9b21b76-be41-4321-a975-e9fbaac38014 req-ab88a45b-de22-4390-8975-f4b85f3eeed7 service nova] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:42.898319 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [req-b9b21b76-be41-4321-a975-e9fbaac38014 req-ab88a45b-de22-4390-8975-f4b85f3eeed7 service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:42.898774 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [req-b9b21b76-be41-4321-a975-e9fbaac38014 req-ab88a45b-de22-4390-8975-f4b85f3eeed7 service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:42.911780 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.compute.server_external_events [req-b9b21b76-be41-4321-a975-e9fbaac38014 req-ab88a45b-de22-4390-8975-f4b85f3eeed7 service nova] Creating event network-vif-plugged:fe97fa1b-e830-46b1-ba10-d58f1d1269f2 for instance cc41312a-3de8-4584-9bcf-a1f31b952025 on hv-cinder-83124 Sep 09 16:32:42.912210 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.compute.server_external_events [req-b9b21b76-be41-4321-a975-e9fbaac38014 req-ab88a45b-de22-4390-8975-f4b85f3eeed7 service nova] Creating event network-vif-plugged:98eca583-6399-4702-a0d5-6321d1da9439 for instance e8d23cb3-2f39-4b00-ae9d-006e392a5940 on hv-cinder-83124 Sep 09 16:32:42.916384 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-ce407e32-a081-437e-bd0d-6b630885bf6d tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:32:42.917255 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-ce407e32-a081-437e-bd0d-6b630885bf6d tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: e8d23cb3-2f39-4b00-ae9d-006e392a5940] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:32:42.918741 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [req-b9b21b76-be41-4321-a975-e9fbaac38014 req-ab88a45b-de22-4390-8975-f4b85f3eeed7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.035726 Sep 09 16:32:42.919811 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 68/136] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Sep 9 16:32:42 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:32:42.924275 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ce407e32-a081-437e-bd0d-6b630885bf6d tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:42.924759 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ce407e32-a081-437e-bd0d-6b630885bf6d tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:42.925193 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ce407e32-a081-437e-bd0d-6b630885bf6d tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:42.925890 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ce407e32-a081-437e-bd0d-6b630885bf6d tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:42.926377 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ce407e32-a081-437e-bd0d-6b630885bf6d tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:42.926929 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ce407e32-a081-437e-bd0d-6b630885bf6d tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:42.928951 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-dd98eadf-a844-4b6f-82d8-244ef1da6cc1 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:32:42.929612 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-dd98eadf-a844-4b6f-82d8-244ef1da6cc1 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] [instance: c453c474-644e-4e46-9d23-b2b87716f5d7] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:32:42.936284 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-dd98eadf-a844-4b6f-82d8-244ef1da6cc1 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:42.936771 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-dd98eadf-a844-4b6f-82d8-244ef1da6cc1 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:42.937202 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-dd98eadf-a844-4b6f-82d8-244ef1da6cc1 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:42.937956 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-dd98eadf-a844-4b6f-82d8-244ef1da6cc1 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:42.938409 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-dd98eadf-a844-4b6f-82d8-244ef1da6cc1 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:42.938894 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-dd98eadf-a844-4b6f-82d8-244ef1da6cc1 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:43.146044 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-ce407e32-a081-437e-bd0d-6b630885bf6d tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d86f09c6304121be2021cb5c15e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ab544d0b547919794e3efb49ba0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:32:43.154590 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-ce407e32-a081-437e-bd0d-6b630885bf6d tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940" status: 200 len: 1322 microversion: 2.1 time: 0.242159 Sep 09 16:32:43.155291 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 69/137] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:32:42 2022] GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940 => generated 1322 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:32:43.174784 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-dd98eadf-a844-4b6f-82d8-244ef1da6cc1 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c0721dc18343b18993ff5af098841d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17967a941be4a04bbc180e2cf3a7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:32:43.183618 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-dd98eadf-a844-4b6f-82d8-244ef1da6cc1 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] 10.222.0.23 "GET /compute/v2.1/servers/c453c474-644e-4e46-9d23-b2b87716f5d7" status: 200 len: 1366 microversion: 2.1 time: 0.258653 Sep 09 16:32:43.185093 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 69/138] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:32:42 2022] GET /compute/v2.1/servers/c453c474-644e-4e46-9d23-b2b87716f5d7 => generated 1366 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:32:43.203594 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-6ced3eb9-c7da-4293-851d-8e0da521b266 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:32:43.204390 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-6ced3eb9-c7da-4293-851d-8e0da521b266 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] [instance: 9e761961-9c74-444c-bb4b-0b2f82a9d698] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:32:43.211403 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6ced3eb9-c7da-4293-851d-8e0da521b266 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:43.212149 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6ced3eb9-c7da-4293-851d-8e0da521b266 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:43.213260 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6ced3eb9-c7da-4293-851d-8e0da521b266 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:43.214306 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6ced3eb9-c7da-4293-851d-8e0da521b266 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:43.214941 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6ced3eb9-c7da-4293-851d-8e0da521b266 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:43.215506 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6ced3eb9-c7da-4293-851d-8e0da521b266 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:43.408042 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-6ced3eb9-c7da-4293-851d-8e0da521b266 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd095ed814b9e47e08d6b5a4fd2901c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f2e0c002343d88ae25dc7bfb2fe10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:32:43.416072 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-6ced3eb9-c7da-4293-851d-8e0da521b266 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] 10.222.0.23 "GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698" status: 200 len: 1362 microversion: 2.1 time: 0.216326 Sep 09 16:32:43.416659 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 70/139] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:32:43 2022] GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698 => generated 1362 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:32:43.482819 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-008edc63-c79d-4697-8278-68e6b4aa2e50 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:32:43.483650 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-008edc63-c79d-4697-8278-68e6b4aa2e50 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] [instance: 15d68c64-0569-4afa-a718-bc0e0c2cba3e] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:32:43.490748 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-008edc63-c79d-4697-8278-68e6b4aa2e50 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:43.491402 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-008edc63-c79d-4697-8278-68e6b4aa2e50 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:43.492056 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-008edc63-c79d-4697-8278-68e6b4aa2e50 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:43.493122 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-008edc63-c79d-4697-8278-68e6b4aa2e50 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:43.493839 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-008edc63-c79d-4697-8278-68e6b4aa2e50 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:43.494486 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-008edc63-c79d-4697-8278-68e6b4aa2e50 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:43.680391 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-008edc63-c79d-4697-8278-68e6b4aa2e50 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce1cd9c19584549b794df8e487abf00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f227ee89ce84dec84410a1db9b479fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:32:43.693306 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-008edc63-c79d-4697-8278-68e6b4aa2e50 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] 10.222.0.23 "GET /compute/v2.1/servers/15d68c64-0569-4afa-a718-bc0e0c2cba3e" status: 200 len: 1313 microversion: 2.1 time: 0.211984 Sep 09 16:32:43.703488 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 70/140] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:32:43 2022] GET /compute/v2.1/servers/15d68c64-0569-4afa-a718-bc0e0c2cba3e => generated 1313 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 16:32:44.179657 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-55dc64d4-c276-4627-af01-9b8f42e828bb tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:32:44.180271 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-55dc64d4-c276-4627-af01-9b8f42e828bb tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: e8d23cb3-2f39-4b00-ae9d-006e392a5940] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:32:44.187047 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-55dc64d4-c276-4627-af01-9b8f42e828bb tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:44.197204 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-55dc64d4-c276-4627-af01-9b8f42e828bb tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:44.202354 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-55dc64d4-c276-4627-af01-9b8f42e828bb tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:44.203398 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-55dc64d4-c276-4627-af01-9b8f42e828bb tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:44.204262 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-55dc64d4-c276-4627-af01-9b8f42e828bb tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:44.204911 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-55dc64d4-c276-4627-af01-9b8f42e828bb tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:44.208808 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-08c3ca8d-ae10-4c87-a3bd-a21d824355c5 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:32:44.209427 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-08c3ca8d-ae10-4c87-a3bd-a21d824355c5 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] [instance: c453c474-644e-4e46-9d23-b2b87716f5d7] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:32:44.223086 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-08c3ca8d-ae10-4c87-a3bd-a21d824355c5 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:44.223677 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-08c3ca8d-ae10-4c87-a3bd-a21d824355c5 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:44.225871 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-08c3ca8d-ae10-4c87-a3bd-a21d824355c5 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:44.227495 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-08c3ca8d-ae10-4c87-a3bd-a21d824355c5 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:44.228268 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-08c3ca8d-ae10-4c87-a3bd-a21d824355c5 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:44.229744 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-08c3ca8d-ae10-4c87-a3bd-a21d824355c5 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:44.522388 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-55dc64d4-c276-4627-af01-9b8f42e828bb tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d86f09c6304121be2021cb5c15e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ab544d0b547919794e3efb49ba0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:32:44.528569 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-08c3ca8d-ae10-4c87-a3bd-a21d824355c5 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c0721dc18343b18993ff5af098841d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17967a941be4a04bbc180e2cf3a7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:32:44.531209 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-55dc64d4-c276-4627-af01-9b8f42e828bb tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940" status: 200 len: 1322 microversion: 2.1 time: 0.355507 Sep 09 16:32:44.531785 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 71/141] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:32:44 2022] GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940 => generated 1322 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:32:44.540832 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-b42bb3af-3d18-40d5-825c-078c586344b4 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:32:44.541668 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-b42bb3af-3d18-40d5-825c-078c586344b4 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] [instance: 9e761961-9c74-444c-bb4b-0b2f82a9d698] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:32:44.546736 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-08c3ca8d-ae10-4c87-a3bd-a21d824355c5 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] 10.222.0.23 "GET /compute/v2.1/servers/c453c474-644e-4e46-9d23-b2b87716f5d7" status: 200 len: 1556 microversion: 2.1 time: 0.343029 Sep 09 16:32:44.548810 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 71/142] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:32:44 2022] GET /compute/v2.1/servers/c453c474-644e-4e46-9d23-b2b87716f5d7 => generated 1556 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 16:32:44.553439 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b42bb3af-3d18-40d5-825c-078c586344b4 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:44.554150 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b42bb3af-3d18-40d5-825c-078c586344b4 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:44.554819 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b42bb3af-3d18-40d5-825c-078c586344b4 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:44.555827 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b42bb3af-3d18-40d5-825c-078c586344b4 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:44.556344 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b42bb3af-3d18-40d5-825c-078c586344b4 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:44.556847 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b42bb3af-3d18-40d5-825c-078c586344b4 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:44.572302 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-3a17fea5-1faf-4f18-9f21-51c470cc5687 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:32:44.572803 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-3a17fea5-1faf-4f18-9f21-51c470cc5687 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] [instance: c453c474-644e-4e46-9d23-b2b87716f5d7] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:32:44.580821 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-3a17fea5-1faf-4f18-9f21-51c470cc5687 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:44.581313 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-3a17fea5-1faf-4f18-9f21-51c470cc5687 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:44.581748 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-3a17fea5-1faf-4f18-9f21-51c470cc5687 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:44.582451 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-3a17fea5-1faf-4f18-9f21-51c470cc5687 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:44.583025 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-3a17fea5-1faf-4f18-9f21-51c470cc5687 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:44.583585 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-3a17fea5-1faf-4f18-9f21-51c470cc5687 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:44.761614 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-3a17fea5-1faf-4f18-9f21-51c470cc5687 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] 10.222.0.23 "GET /compute/v2.1/servers/c453c474-644e-4e46-9d23-b2b87716f5d7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.193280 Sep 09 16:32:44.762864 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 72/143] 10.222.0.23 () {58 vars in 1275 bytes} [Fri Sep 9 16:32:44 2022] GET /compute/v2.1/servers/c453c474-644e-4e46-9d23-b2b87716f5d7/os-interface => generated 284 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:32:44.766893 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-b42bb3af-3d18-40d5-825c-078c586344b4 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd095ed814b9e47e08d6b5a4fd2901c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f2e0c002343d88ae25dc7bfb2fe10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:32:44.780566 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-21709614-a312-463c-9e0b-a7f1f2587018 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:32:44.782455 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-21709614-a312-463c-9e0b-a7f1f2587018 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] [instance: 15d68c64-0569-4afa-a718-bc0e0c2cba3e] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:32:44.784694 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-b42bb3af-3d18-40d5-825c-078c586344b4 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] 10.222.0.23 "GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698" status: 200 len: 1362 microversion: 2.1 time: 0.250544 Sep 09 16:32:44.785314 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 72/144] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:32:44 2022] GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698 => generated 1362 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:32:44.789812 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-21709614-a312-463c-9e0b-a7f1f2587018 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:44.790375 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-21709614-a312-463c-9e0b-a7f1f2587018 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:44.790896 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-21709614-a312-463c-9e0b-a7f1f2587018 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:44.791668 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-21709614-a312-463c-9e0b-a7f1f2587018 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:44.792193 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-21709614-a312-463c-9e0b-a7f1f2587018 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:44.792687 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-21709614-a312-463c-9e0b-a7f1f2587018 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:44.936285 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [req-57086166-4394-4578-87e8-7510c63e70c1 req-13d34cf1-a8bb-40cc-8ee0-99c66a3cc947 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15d68c64-0569-4afa-a718-bc0e0c2cba3e", "name": "network-vif-plugged", "status": "completed", "tag": "7a3fbdb4-6907-451e-a2ff-a2463ac94347"}, {"server_uuid": "9e761961-9c74-444c-bb4b-0b2f82a9d698", "name": "network-vif-plugged", "status": "completed", "tag": "a26fe3a3-c8fd-45e4-8105-8c34395addd8"}]} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:32:44.947337 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-57086166-4394-4578-87e8-7510c63e70c1 req-13d34cf1-a8bb-40cc-8ee0-99c66a3cc947 service nova] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:44.948110 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-57086166-4394-4578-87e8-7510c63e70c1 req-13d34cf1-a8bb-40cc-8ee0-99c66a3cc947 service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:44.949209 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-57086166-4394-4578-87e8-7510c63e70c1 req-13d34cf1-a8bb-40cc-8ee0-99c66a3cc947 service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:44.968323 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.compute.server_external_events [req-57086166-4394-4578-87e8-7510c63e70c1 req-13d34cf1-a8bb-40cc-8ee0-99c66a3cc947 service nova] Creating event network-vif-plugged:7a3fbdb4-6907-451e-a2ff-a2463ac94347 for instance 15d68c64-0569-4afa-a718-bc0e0c2cba3e on hv-cinder-83124 Sep 09 16:32:44.969254 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.compute.server_external_events [req-57086166-4394-4578-87e8-7510c63e70c1 req-13d34cf1-a8bb-40cc-8ee0-99c66a3cc947 service nova] Creating event network-vif-plugged:a26fe3a3-c8fd-45e4-8105-8c34395addd8 for instance 9e761961-9c74-444c-bb4b-0b2f82a9d698 on hv-cinder-83124 Sep 09 16:32:44.979165 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [req-57086166-4394-4578-87e8-7510c63e70c1 req-13d34cf1-a8bb-40cc-8ee0-99c66a3cc947 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.047092 Sep 09 16:32:44.980972 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 73/145] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Sep 9 16:32:44 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 16:32:45.141330 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-21709614-a312-463c-9e0b-a7f1f2587018 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce1cd9c19584549b794df8e487abf00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f227ee89ce84dec84410a1db9b479fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:32:45.151184 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-21709614-a312-463c-9e0b-a7f1f2587018 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] 10.222.0.23 "GET /compute/v2.1/servers/15d68c64-0569-4afa-a718-bc0e0c2cba3e" status: 200 len: 1313 microversion: 2.1 time: 0.387014 Sep 09 16:32:45.151773 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 73/146] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:32:44 2022] GET /compute/v2.1/servers/15d68c64-0569-4afa-a718-bc0e0c2cba3e => generated 1313 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:32:45.558085 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-4c9b4bc3-e621-4127-b47e-dc0ed22da1ab tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:32:45.559417 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-4c9b4bc3-e621-4127-b47e-dc0ed22da1ab tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: e8d23cb3-2f39-4b00-ae9d-006e392a5940] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:32:45.566007 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4c9b4bc3-e621-4127-b47e-dc0ed22da1ab tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:45.566788 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4c9b4bc3-e621-4127-b47e-dc0ed22da1ab tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:45.567530 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4c9b4bc3-e621-4127-b47e-dc0ed22da1ab tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:45.568572 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4c9b4bc3-e621-4127-b47e-dc0ed22da1ab tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:45.569260 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4c9b4bc3-e621-4127-b47e-dc0ed22da1ab tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:45.570077 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4c9b4bc3-e621-4127-b47e-dc0ed22da1ab tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:45.812999 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-37763dd5-0ebc-4d65-bd7c-f6ab7d7839f1 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:32:45.813822 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-37763dd5-0ebc-4d65-bd7c-f6ab7d7839f1 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] [instance: 9e761961-9c74-444c-bb4b-0b2f82a9d698] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:32:45.824679 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-37763dd5-0ebc-4d65-bd7c-f6ab7d7839f1 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:45.825096 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-37763dd5-0ebc-4d65-bd7c-f6ab7d7839f1 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:45.825846 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-37763dd5-0ebc-4d65-bd7c-f6ab7d7839f1 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:45.827133 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-37763dd5-0ebc-4d65-bd7c-f6ab7d7839f1 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:45.827940 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-37763dd5-0ebc-4d65-bd7c-f6ab7d7839f1 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:45.828674 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-37763dd5-0ebc-4d65-bd7c-f6ab7d7839f1 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:46.258059 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-4c9b4bc3-e621-4127-b47e-dc0ed22da1ab tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d86f09c6304121be2021cb5c15e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ab544d0b547919794e3efb49ba0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:32:46.265755 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-4c9b4bc3-e621-4127-b47e-dc0ed22da1ab tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940" status: 200 len: 1322 microversion: 2.1 time: 0.712448 Sep 09 16:32:46.266337 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 74/147] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:32:45 2022] GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940 => generated 1322 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:32:46.279529 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-a54e7c13-1840-4af9-adbc-de53360ff6d6 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:32:46.280219 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-a54e7c13-1840-4af9-adbc-de53360ff6d6 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] [instance: 15d68c64-0569-4afa-a718-bc0e0c2cba3e] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:32:46.292596 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a54e7c13-1840-4af9-adbc-de53360ff6d6 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:46.293311 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a54e7c13-1840-4af9-adbc-de53360ff6d6 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:46.299313 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a54e7c13-1840-4af9-adbc-de53360ff6d6 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:46.300247 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a54e7c13-1840-4af9-adbc-de53360ff6d6 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:46.300884 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a54e7c13-1840-4af9-adbc-de53360ff6d6 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:46.301463 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a54e7c13-1840-4af9-adbc-de53360ff6d6 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:46.314042 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-37763dd5-0ebc-4d65-bd7c-f6ab7d7839f1 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd095ed814b9e47e08d6b5a4fd2901c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f2e0c002343d88ae25dc7bfb2fe10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:32:46.330135 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-37763dd5-0ebc-4d65-bd7c-f6ab7d7839f1 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] 10.222.0.23 "GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698" status: 200 len: 1362 microversion: 2.1 time: 0.521756 Sep 09 16:32:46.348920 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 74/148] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:32:45 2022] GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698 => generated 1362 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:32:46.572874 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-a54e7c13-1840-4af9-adbc-de53360ff6d6 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce1cd9c19584549b794df8e487abf00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f227ee89ce84dec84410a1db9b479fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:32:46.585686 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-a54e7c13-1840-4af9-adbc-de53360ff6d6 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] 10.222.0.23 "GET /compute/v2.1/servers/15d68c64-0569-4afa-a718-bc0e0c2cba3e" status: 200 len: 1313 microversion: 2.1 time: 0.309947 Sep 09 16:32:46.586457 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 75/149] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:32:46 2022] GET /compute/v2.1/servers/15d68c64-0569-4afa-a718-bc0e0c2cba3e => generated 1313 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:32:46.838593 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [req-b3ad1902-9da8-49be-902f-d99adb089be8 req-57fd68ca-5fec-44d7-98da-271ee88aea4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c453c474-644e-4e46-9d23-b2b87716f5d7", "tag": "4976ea2e-5f69-46bc-9cfb-142523115ea4"}]} {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:32:46.859513 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [req-b3ad1902-9da8-49be-902f-d99adb089be8 req-57fd68ca-5fec-44d7-98da-271ee88aea4f service nova] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:46.860376 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [req-b3ad1902-9da8-49be-902f-d99adb089be8 req-57fd68ca-5fec-44d7-98da-271ee88aea4f service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:46.861611 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [req-b3ad1902-9da8-49be-902f-d99adb089be8 req-57fd68ca-5fec-44d7-98da-271ee88aea4f service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:46.892527 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.compute.server_external_events [req-b3ad1902-9da8-49be-902f-d99adb089be8 req-57fd68ca-5fec-44d7-98da-271ee88aea4f service nova] Creating event network-changed:4976ea2e-5f69-46bc-9cfb-142523115ea4 for instance c453c474-644e-4e46-9d23-b2b87716f5d7 on hv-cinder-83124 Sep 09 16:32:46.899887 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [req-b3ad1902-9da8-49be-902f-d99adb089be8 req-57fd68ca-5fec-44d7-98da-271ee88aea4f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065933 Sep 09 16:32:46.901079 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 75/150] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Sep 9 16:32:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:32:47.288639 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-d552591a-8b4e-472a-9eae-39b8d59aa6a8 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:32:47.289523 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-d552591a-8b4e-472a-9eae-39b8d59aa6a8 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: e8d23cb3-2f39-4b00-ae9d-006e392a5940] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:32:47.303646 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d552591a-8b4e-472a-9eae-39b8d59aa6a8 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:47.304146 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d552591a-8b4e-472a-9eae-39b8d59aa6a8 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:47.304578 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d552591a-8b4e-472a-9eae-39b8d59aa6a8 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:47.306793 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d552591a-8b4e-472a-9eae-39b8d59aa6a8 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:47.308976 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d552591a-8b4e-472a-9eae-39b8d59aa6a8 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:47.310988 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d552591a-8b4e-472a-9eae-39b8d59aa6a8 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:47.358813 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-84e2d1da-63d5-4794-926b-eb8e16ab99b6 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:32:47.360749 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-84e2d1da-63d5-4794-926b-eb8e16ab99b6 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] [instance: 9e761961-9c74-444c-bb4b-0b2f82a9d698] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:32:47.369484 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-84e2d1da-63d5-4794-926b-eb8e16ab99b6 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:47.369973 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-84e2d1da-63d5-4794-926b-eb8e16ab99b6 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:47.371131 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-84e2d1da-63d5-4794-926b-eb8e16ab99b6 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:47.371835 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-84e2d1da-63d5-4794-926b-eb8e16ab99b6 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:47.372283 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-84e2d1da-63d5-4794-926b-eb8e16ab99b6 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:47.378980 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-84e2d1da-63d5-4794-926b-eb8e16ab99b6 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:47.552317 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-d552591a-8b4e-472a-9eae-39b8d59aa6a8 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d86f09c6304121be2021cb5c15e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ab544d0b547919794e3efb49ba0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:32:47.560028 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-d552591a-8b4e-472a-9eae-39b8d59aa6a8 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940" status: 200 len: 1322 microversion: 2.1 time: 0.275275 Sep 09 16:32:47.571092 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 76/151] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:32:47 2022] GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940 => generated 1322 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:32:47.588339 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-84e2d1da-63d5-4794-926b-eb8e16ab99b6 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd095ed814b9e47e08d6b5a4fd2901c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f2e0c002343d88ae25dc7bfb2fe10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:32:47.603864 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-84e2d1da-63d5-4794-926b-eb8e16ab99b6 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] 10.222.0.23 "GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698" status: 200 len: 1362 microversion: 2.1 time: 0.250515 Sep 09 16:32:47.603864 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 76/152] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:32:47 2022] GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698 => generated 1362 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:32:47.623089 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-a112d315-72ce-4844-ab15-e3d658ccf19a tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:32:47.623737 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-a112d315-72ce-4844-ab15-e3d658ccf19a tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] [instance: 15d68c64-0569-4afa-a718-bc0e0c2cba3e] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:32:47.630921 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a112d315-72ce-4844-ab15-e3d658ccf19a tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:47.631910 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a112d315-72ce-4844-ab15-e3d658ccf19a tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:47.632523 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a112d315-72ce-4844-ab15-e3d658ccf19a tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:47.633742 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a112d315-72ce-4844-ab15-e3d658ccf19a tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:47.634395 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a112d315-72ce-4844-ab15-e3d658ccf19a tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:47.635035 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a112d315-72ce-4844-ab15-e3d658ccf19a tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:47.870907 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-a112d315-72ce-4844-ab15-e3d658ccf19a tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce1cd9c19584549b794df8e487abf00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f227ee89ce84dec84410a1db9b479fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:32:47.880489 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-a112d315-72ce-4844-ab15-e3d658ccf19a tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] 10.222.0.23 "GET /compute/v2.1/servers/15d68c64-0569-4afa-a718-bc0e0c2cba3e" status: 200 len: 1313 microversion: 2.1 time: 0.265100 Sep 09 16:32:47.881361 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 77/153] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:32:47 2022] GET /compute/v2.1/servers/15d68c64-0569-4afa-a718-bc0e0c2cba3e => generated 1313 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:32:48.584154 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-ada75d7d-c08e-4668-9c03-0229b73aa395 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:32:48.585382 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-ada75d7d-c08e-4668-9c03-0229b73aa395 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: e8d23cb3-2f39-4b00-ae9d-006e392a5940] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:32:48.594641 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-ada75d7d-c08e-4668-9c03-0229b73aa395 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:48.595226 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-ada75d7d-c08e-4668-9c03-0229b73aa395 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:48.595624 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-ada75d7d-c08e-4668-9c03-0229b73aa395 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:48.598818 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-ada75d7d-c08e-4668-9c03-0229b73aa395 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:48.599291 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-ada75d7d-c08e-4668-9c03-0229b73aa395 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:48.599781 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-ada75d7d-c08e-4668-9c03-0229b73aa395 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:48.629983 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-c0c02455-7ba3-4647-9476-72b02beb1454 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:32:48.633943 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-c0c02455-7ba3-4647-9476-72b02beb1454 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] [instance: 9e761961-9c74-444c-bb4b-0b2f82a9d698] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:32:48.653197 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c0c02455-7ba3-4647-9476-72b02beb1454 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:48.653696 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c0c02455-7ba3-4647-9476-72b02beb1454 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:48.654130 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c0c02455-7ba3-4647-9476-72b02beb1454 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:48.659650 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c0c02455-7ba3-4647-9476-72b02beb1454 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:48.660491 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c0c02455-7ba3-4647-9476-72b02beb1454 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:48.661875 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c0c02455-7ba3-4647-9476-72b02beb1454 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:48.999734 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-ada75d7d-c08e-4668-9c03-0229b73aa395 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d86f09c6304121be2021cb5c15e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ab544d0b547919794e3efb49ba0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:32:49.010717 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-ada75d7d-c08e-4668-9c03-0229b73aa395 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940" status: 200 len: 1516 microversion: 2.1 time: 0.430614 Sep 09 16:32:49.011575 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 77/154] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:32:48 2022] GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940 => generated 1516 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:32:49.025477 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-7e57c3c6-255c-4037-a6dd-385db49ceafe tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2096608770", "imageRef": "0b1ba34f-2223-497a-9a18-c2ad8d398aae", "flavorRef": "452", "networks": [{"uuid": "52494a8a-ce3b-4fa0-8de6-85face071618"}]}} {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:32:49.039795 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-c0c02455-7ba3-4647-9476-72b02beb1454 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd095ed814b9e47e08d6b5a4fd2901c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f2e0c002343d88ae25dc7bfb2fe10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:32:49.050800 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-c0c02455-7ba3-4647-9476-72b02beb1454 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] 10.222.0.23 "GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698" status: 200 len: 1362 microversion: 2.1 time: 0.426812 Sep 09 16:32:49.052597 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 78/155] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:32:48 2022] GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698 => generated 1362 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:32:49.059544 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-93631cf4-62f0-4ecc-b616-74a49191661e tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:32:49.060502 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-93631cf4-62f0-4ecc-b616-74a49191661e tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] [instance: 15d68c64-0569-4afa-a718-bc0e0c2cba3e] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:32:49.068816 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-93631cf4-62f0-4ecc-b616-74a49191661e tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:49.069804 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-93631cf4-62f0-4ecc-b616-74a49191661e tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:49.071151 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-93631cf4-62f0-4ecc-b616-74a49191661e tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:49.072854 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-93631cf4-62f0-4ecc-b616-74a49191661e tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:49.073465 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-93631cf4-62f0-4ecc-b616-74a49191661e tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:49.073950 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-93631cf4-62f0-4ecc-b616-74a49191661e tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:49.162412 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.network.neutron [None req-7e57c3c6-255c-4037-a6dd-385db49ceafe tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] validate_networks() for [('52494a8a-ce3b-4fa0-8de6-85face071618', None, None, None, None, None)] {{(pid=127196) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 16:32:49.341437 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-93631cf4-62f0-4ecc-b616-74a49191661e tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce1cd9c19584549b794df8e487abf00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f227ee89ce84dec84410a1db9b479fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:32:49.362878 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-93631cf4-62f0-4ecc-b616-74a49191661e tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] 10.222.0.23 "GET /compute/v2.1/servers/15d68c64-0569-4afa-a718-bc0e0c2cba3e" status: 200 len: 1313 microversion: 2.1 time: 0.308807 Sep 09 16:32:49.363567 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 79/156] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:32:49 2022] GET /compute/v2.1/servers/15d68c64-0569-4afa-a718-bc0e0c2cba3e => generated 1313 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:32:49.368925 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-2ce23626-f435-488b-ad83-5157c1d14beb tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:32:49.371530 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-2ce23626-f435-488b-ad83-5157c1d14beb tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: e8d23cb3-2f39-4b00-ae9d-006e392a5940] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:32:49.377572 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2ce23626-f435-488b-ad83-5157c1d14beb tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:49.378181 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2ce23626-f435-488b-ad83-5157c1d14beb tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:49.378949 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2ce23626-f435-488b-ad83-5157c1d14beb tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:49.379929 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2ce23626-f435-488b-ad83-5157c1d14beb tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:49.380588 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2ce23626-f435-488b-ad83-5157c1d14beb tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:49.381232 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2ce23626-f435-488b-ad83-5157c1d14beb tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:49.471794 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.objects.instance [None req-2ce23626-f435-488b-ad83-5157c1d14beb tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lazy-loading 'flavor' on Instance uuid e8d23cb3-2f39-4b00-ae9d-006e392a5940 {{(pid=127198) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 16:32:49.640613 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-2ce23626-f435-488b-ad83-5157c1d14beb tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "POST /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940/action" status: 200 len: 32 microversion: 2.1 time: 0.275445 Sep 09 16:32:49.645943 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 80/157] 10.222.0.23 () {60 vars in 1278 bytes} [Fri Sep 9 16:32:49 2022] POST /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940/action => generated 32 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 09 16:32:49.651898 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-d5a98581-7389-42ee-8e38-87b79a7fb4ac tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:32:49.652705 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-d5a98581-7389-42ee-8e38-87b79a7fb4ac tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: e8d23cb3-2f39-4b00-ae9d-006e392a5940] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:32:49.659093 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d5a98581-7389-42ee-8e38-87b79a7fb4ac tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:49.659709 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d5a98581-7389-42ee-8e38-87b79a7fb4ac tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:49.660247 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d5a98581-7389-42ee-8e38-87b79a7fb4ac tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:49.661179 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d5a98581-7389-42ee-8e38-87b79a7fb4ac tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:49.661688 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d5a98581-7389-42ee-8e38-87b79a7fb4ac tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:49.662162 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d5a98581-7389-42ee-8e38-87b79a7fb4ac tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:49.865923 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.virt.hardware [None req-7e57c3c6-255c-4037-a6dd-385db49ceafe tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Flavor limits 0:0:0 {{(pid=127196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 16:32:49.866415 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.virt.hardware [None req-7e57c3c6-255c-4037-a6dd-385db49ceafe tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Image limits 0:0:0 {{(pid=127196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 16:32:49.867319 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.virt.hardware [None req-7e57c3c6-255c-4037-a6dd-385db49ceafe tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Flavor pref 0:0:0 {{(pid=127196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 16:32:49.867855 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.virt.hardware [None req-7e57c3c6-255c-4037-a6dd-385db49ceafe tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Image pref 0:0:0 {{(pid=127196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 16:32:49.868336 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.virt.hardware [None req-7e57c3c6-255c-4037-a6dd-385db49ceafe tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 16:32:49.877840 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-7e57c3c6-255c-4037-a6dd-385db49ceafe tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:49.878663 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-7e57c3c6-255c-4037-a6dd-385db49ceafe tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:49.879225 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-7e57c3c6-255c-4037-a6dd-385db49ceafe tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:49.880147 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-7e57c3c6-255c-4037-a6dd-385db49ceafe tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:49.880735 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-7e57c3c6-255c-4037-a6dd-385db49ceafe tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:49.881255 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-7e57c3c6-255c-4037-a6dd-385db49ceafe tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:49.884827 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-d5a98581-7389-42ee-8e38-87b79a7fb4ac tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d86f09c6304121be2021cb5c15e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ab544d0b547919794e3efb49ba0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:32:49.893375 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-d5a98581-7389-42ee-8e38-87b79a7fb4ac tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940" status: 200 len: 1522 microversion: 2.1 time: 0.245861 Sep 09 16:32:49.893960 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 81/158] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:32:49 2022] GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940 => generated 1522 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:32:49.903822 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.quota [None req-7e57c3c6-255c-4037-a6dd-385db49ceafe tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Getting quotas for project e9243cdc25d5444d847db4f59c05fa6a. Resources: {'cores', 'instances', 'ram'} {{(pid=127196) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 16:32:49.908011 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.quota [None req-7e57c3c6-255c-4037-a6dd-385db49ceafe tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Getting quotas for user 6d2fbc3668cf4a82b8eea0b67b87ca80 and project e9243cdc25d5444d847db4f59c05fa6a. Resources: {'cores', 'instances', 'ram'} {{(pid=127196) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 16:32:49.922636 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-7e57c3c6-255c-4037-a6dd-385db49ceafe tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Going to run 1 instances... {{(pid=127196) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 16:32:49.925352 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-7e57c3c6-255c-4037-a6dd-385db49ceafe tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] [instance: 4d413d7e-76c6-4b49-a7f0-ca29701c8817] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0b1ba34f-2223-497a-9a18-c2ad8d398aae',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127196) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 16:32:49.954105 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG dbcounter [-] [127196] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:32:49.982755 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-7e57c3c6-255c-4037-a6dd-385db49ceafe tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.968550 Sep 09 16:32:49.982755 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 78/159] 10.222.0.23 () {60 vars in 1147 bytes} [Fri Sep 9 16:32:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 970 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 16:32:50.002951 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-d957b55d-cd3a-434e-af1f-cadb930d3214 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:32:50.002951 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-d957b55d-cd3a-434e-af1f-cadb930d3214 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] [instance: 4d413d7e-76c6-4b49-a7f0-ca29701c8817] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:32:50.003238 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_api:SELECT=97 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:32:50.074073 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-57c48ce3-72e0-4909-8bff-a361c92aa438 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:32:50.075026 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-57c48ce3-72e0-4909-8bff-a361c92aa438 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] [instance: 9e761961-9c74-444c-bb4b-0b2f82a9d698] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:32:50.083653 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-57c48ce3-72e0-4909-8bff-a361c92aa438 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:50.084424 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-57c48ce3-72e0-4909-8bff-a361c92aa438 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:50.085036 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-57c48ce3-72e0-4909-8bff-a361c92aa438 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:50.085976 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-d957b55d-cd3a-434e-af1f-cadb930d3214 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2fbc3668cf4a82b8eea0b67b87ca80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9243cdc25d5444d847db4f59c05fa6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:32:50.086321 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-57c48ce3-72e0-4909-8bff-a361c92aa438 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:50.087426 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-57c48ce3-72e0-4909-8bff-a361c92aa438 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:50.088020 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-57c48ce3-72e0-4909-8bff-a361c92aa438 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:50.101716 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-d957b55d-cd3a-434e-af1f-cadb930d3214 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] 10.222.0.23 "GET /compute/v2.1/servers/4d413d7e-76c6-4b49-a7f0-ca29701c8817" status: 200 len: 1214 microversion: 2.1 time: 0.111984 Sep 09 16:32:50.102393 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 82/160] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:32:49 2022] GET /compute/v2.1/servers/4d413d7e-76c6-4b49-a7f0-ca29701c8817 => generated 1214 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:32:50.253328 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-57c48ce3-72e0-4909-8bff-a361c92aa438 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd095ed814b9e47e08d6b5a4fd2901c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f2e0c002343d88ae25dc7bfb2fe10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:32:50.264909 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-57c48ce3-72e0-4909-8bff-a361c92aa438 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] 10.222.0.23 "GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698" status: 200 len: 1362 microversion: 2.1 time: 0.195027 Sep 09 16:32:50.266314 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 79/161] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:32:50 2022] GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698 => generated 1362 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 16:32:50.385736 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-b6639ca6-b690-4db3-8ae6-daac9c81a2d2 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:32:50.386386 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-b6639ca6-b690-4db3-8ae6-daac9c81a2d2 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] [instance: 15d68c64-0569-4afa-a718-bc0e0c2cba3e] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:32:50.394904 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b6639ca6-b690-4db3-8ae6-daac9c81a2d2 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:50.395792 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b6639ca6-b690-4db3-8ae6-daac9c81a2d2 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:50.396473 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b6639ca6-b690-4db3-8ae6-daac9c81a2d2 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:50.397336 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b6639ca6-b690-4db3-8ae6-daac9c81a2d2 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:50.398058 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b6639ca6-b690-4db3-8ae6-daac9c81a2d2 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:50.398798 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b6639ca6-b690-4db3-8ae6-daac9c81a2d2 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:50.645865 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-b6639ca6-b690-4db3-8ae6-daac9c81a2d2 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce1cd9c19584549b794df8e487abf00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f227ee89ce84dec84410a1db9b479fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:32:50.653399 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-b6639ca6-b690-4db3-8ae6-daac9c81a2d2 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] 10.222.0.23 "GET /compute/v2.1/servers/15d68c64-0569-4afa-a718-bc0e0c2cba3e" status: 200 len: 1313 microversion: 2.1 time: 0.271952 Sep 09 16:32:50.653957 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 83/162] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:32:50 2022] GET /compute/v2.1/servers/15d68c64-0569-4afa-a718-bc0e0c2cba3e => generated 1313 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:32:50.917327 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-f0f8ad37-dcd8-42ca-bb60-b1476169d1d8 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:32:50.917980 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-f0f8ad37-dcd8-42ca-bb60-b1476169d1d8 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: e8d23cb3-2f39-4b00-ae9d-006e392a5940] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:32:50.924324 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f0f8ad37-dcd8-42ca-bb60-b1476169d1d8 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:50.924790 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f0f8ad37-dcd8-42ca-bb60-b1476169d1d8 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:50.925323 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f0f8ad37-dcd8-42ca-bb60-b1476169d1d8 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:50.926103 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f0f8ad37-dcd8-42ca-bb60-b1476169d1d8 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:50.926598 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f0f8ad37-dcd8-42ca-bb60-b1476169d1d8 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:50.927065 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f0f8ad37-dcd8-42ca-bb60-b1476169d1d8 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:51.127086 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-00def259-0b38-4e19-8fa6-9e2b5a4d4973 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:32:51.127689 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-00def259-0b38-4e19-8fa6-9e2b5a4d4973 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] [instance: 4d413d7e-76c6-4b49-a7f0-ca29701c8817] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:32:51.134845 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-00def259-0b38-4e19-8fa6-9e2b5a4d4973 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:51.135541 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-00def259-0b38-4e19-8fa6-9e2b5a4d4973 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:51.136115 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-00def259-0b38-4e19-8fa6-9e2b5a4d4973 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:51.136989 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-00def259-0b38-4e19-8fa6-9e2b5a4d4973 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:51.137582 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-00def259-0b38-4e19-8fa6-9e2b5a4d4973 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:51.138200 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-00def259-0b38-4e19-8fa6-9e2b5a4d4973 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:51.253719 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-00def259-0b38-4e19-8fa6-9e2b5a4d4973 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2fbc3668cf4a82b8eea0b67b87ca80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9243cdc25d5444d847db4f59c05fa6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:32:51.266265 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-00def259-0b38-4e19-8fa6-9e2b5a4d4973 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] 10.222.0.23 "GET /compute/v2.1/servers/4d413d7e-76c6-4b49-a7f0-ca29701c8817" status: 200 len: 1218 microversion: 2.1 time: 0.142618 Sep 09 16:32:51.267267 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 84/163] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:32:51 2022] GET /compute/v2.1/servers/4d413d7e-76c6-4b49-a7f0-ca29701c8817 => generated 1218 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:32:51.274821 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-f0f8ad37-dcd8-42ca-bb60-b1476169d1d8 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d86f09c6304121be2021cb5c15e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ab544d0b547919794e3efb49ba0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:32:51.291190 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-f0f8ad37-dcd8-42ca-bb60-b1476169d1d8 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940" status: 200 len: 1522 microversion: 2.1 time: 0.377397 Sep 09 16:32:51.291773 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 80/164] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:32:50 2022] GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940 => generated 1522 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:32:51.294366 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-0e19a897-76c7-45ce-9630-945bc11a4875 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:32:51.295162 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-0e19a897-76c7-45ce-9630-945bc11a4875 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] [instance: 9e761961-9c74-444c-bb4b-0b2f82a9d698] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:32:51.303587 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0e19a897-76c7-45ce-9630-945bc11a4875 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:51.304390 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0e19a897-76c7-45ce-9630-945bc11a4875 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:51.304860 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0e19a897-76c7-45ce-9630-945bc11a4875 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:51.305990 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0e19a897-76c7-45ce-9630-945bc11a4875 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:51.306467 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0e19a897-76c7-45ce-9630-945bc11a4875 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:51.306900 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0e19a897-76c7-45ce-9630-945bc11a4875 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:51.311406 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:32:51.463485 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-0e19a897-76c7-45ce-9630-945bc11a4875 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd095ed814b9e47e08d6b5a4fd2901c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f2e0c002343d88ae25dc7bfb2fe10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:32:51.473450 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-0e19a897-76c7-45ce-9630-945bc11a4875 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] 10.222.0.23 "GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698" status: 200 len: 1362 microversion: 2.1 time: 0.185585 Sep 09 16:32:51.474472 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 85/165] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:32:51 2022] GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698 => generated 1362 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:32:51.677024 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-d2d22796-bf55-49e4-ae95-01adc4062eb5 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:32:51.678237 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-d2d22796-bf55-49e4-ae95-01adc4062eb5 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] [instance: 15d68c64-0569-4afa-a718-bc0e0c2cba3e] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:32:51.684715 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-d2d22796-bf55-49e4-ae95-01adc4062eb5 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:51.685507 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-d2d22796-bf55-49e4-ae95-01adc4062eb5 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:51.686123 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-d2d22796-bf55-49e4-ae95-01adc4062eb5 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:51.687064 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-d2d22796-bf55-49e4-ae95-01adc4062eb5 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:51.687715 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-d2d22796-bf55-49e4-ae95-01adc4062eb5 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:51.688381 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-d2d22796-bf55-49e4-ae95-01adc4062eb5 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:52.217985 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-d2d22796-bf55-49e4-ae95-01adc4062eb5 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce1cd9c19584549b794df8e487abf00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f227ee89ce84dec84410a1db9b479fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:32:52.229635 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-d2d22796-bf55-49e4-ae95-01adc4062eb5 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] 10.222.0.23 "GET /compute/v2.1/servers/15d68c64-0569-4afa-a718-bc0e0c2cba3e" status: 200 len: 1500 microversion: 2.1 time: 0.557222 Sep 09 16:32:52.230236 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 81/166] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:32:51 2022] GET /compute/v2.1/servers/15d68c64-0569-4afa-a718-bc0e0c2cba3e => generated 1500 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:32:52.302983 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-4a10d847-89f9-44b4-86b8-6e0fc8cdc775 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:32:52.305008 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-4a10d847-89f9-44b4-86b8-6e0fc8cdc775 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] [instance: 4d413d7e-76c6-4b49-a7f0-ca29701c8817] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:32:52.318226 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-e3557fce-d4e6-4185-87e1-3c811e2e8fd3 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:32:52.318914 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-e3557fce-d4e6-4185-87e1-3c811e2e8fd3 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: e8d23cb3-2f39-4b00-ae9d-006e392a5940] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:32:52.325761 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4a10d847-89f9-44b4-86b8-6e0fc8cdc775 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:52.326243 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4a10d847-89f9-44b4-86b8-6e0fc8cdc775 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:52.326693 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4a10d847-89f9-44b4-86b8-6e0fc8cdc775 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:52.327538 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4a10d847-89f9-44b4-86b8-6e0fc8cdc775 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:52.330963 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e3557fce-d4e6-4185-87e1-3c811e2e8fd3 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:52.331447 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e3557fce-d4e6-4185-87e1-3c811e2e8fd3 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:52.331871 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e3557fce-d4e6-4185-87e1-3c811e2e8fd3 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:52.332691 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4a10d847-89f9-44b4-86b8-6e0fc8cdc775 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:52.333583 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e3557fce-d4e6-4185-87e1-3c811e2e8fd3 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:52.334186 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4a10d847-89f9-44b4-86b8-6e0fc8cdc775 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:52.336152 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e3557fce-d4e6-4185-87e1-3c811e2e8fd3 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:52.336787 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e3557fce-d4e6-4185-87e1-3c811e2e8fd3 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:52.551906 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-4a10d847-89f9-44b4-86b8-6e0fc8cdc775 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2fbc3668cf4a82b8eea0b67b87ca80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9243cdc25d5444d847db4f59c05fa6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:32:52.576222 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-4a10d847-89f9-44b4-86b8-6e0fc8cdc775 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] 10.222.0.23 "GET /compute/v2.1/servers/4d413d7e-76c6-4b49-a7f0-ca29701c8817" status: 200 len: 1266 microversion: 2.1 time: 0.285545 Sep 09 16:32:52.579381 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 86/167] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:32:52 2022] GET /compute/v2.1/servers/4d413d7e-76c6-4b49-a7f0-ca29701c8817 => generated 1266 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:32:52.592046 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-b105a96b-1325-4c63-9cf0-b615b0ea55d0 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:32:52.592956 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-b105a96b-1325-4c63-9cf0-b615b0ea55d0 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] [instance: 9e761961-9c74-444c-bb4b-0b2f82a9d698] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:32:52.600410 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b105a96b-1325-4c63-9cf0-b615b0ea55d0 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:52.601538 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b105a96b-1325-4c63-9cf0-b615b0ea55d0 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:52.602652 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b105a96b-1325-4c63-9cf0-b615b0ea55d0 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:52.604091 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b105a96b-1325-4c63-9cf0-b615b0ea55d0 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:52.604814 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b105a96b-1325-4c63-9cf0-b615b0ea55d0 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:52.617825 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b105a96b-1325-4c63-9cf0-b615b0ea55d0 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:52.768799 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-e3557fce-d4e6-4185-87e1-3c811e2e8fd3 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d86f09c6304121be2021cb5c15e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ab544d0b547919794e3efb49ba0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:32:52.791182 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-e3557fce-d4e6-4185-87e1-3c811e2e8fd3 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940" status: 200 len: 1522 microversion: 2.1 time: 0.468795 Sep 09 16:32:52.791182 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 82/168] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:32:52 2022] GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940 => generated 1522 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:32:52.892162 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-b105a96b-1325-4c63-9cf0-b615b0ea55d0 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd095ed814b9e47e08d6b5a4fd2901c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f2e0c002343d88ae25dc7bfb2fe10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:32:52.900744 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-b105a96b-1325-4c63-9cf0-b615b0ea55d0 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] 10.222.0.23 "GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698" status: 200 len: 1547 microversion: 2.1 time: 0.319546 Sep 09 16:32:52.902035 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 87/169] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:32:52 2022] GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698 => generated 1547 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:32:52.927645 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-0de0d3c2-a41a-48d6-aed0-512a5e980a0e tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:32:52.928300 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-0de0d3c2-a41a-48d6-aed0-512a5e980a0e tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] [instance: 9e761961-9c74-444c-bb4b-0b2f82a9d698] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:32:52.934786 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-0de0d3c2-a41a-48d6-aed0-512a5e980a0e tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:52.935501 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-0de0d3c2-a41a-48d6-aed0-512a5e980a0e tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:52.936142 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-0de0d3c2-a41a-48d6-aed0-512a5e980a0e tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:52.937221 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-0de0d3c2-a41a-48d6-aed0-512a5e980a0e tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:52.938075 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-0de0d3c2-a41a-48d6-aed0-512a5e980a0e tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:52.938816 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-0de0d3c2-a41a-48d6-aed0-512a5e980a0e tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:52.957380 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG dbcounter [-] [127196] Writing DB stats nova_cell1:SELECT=100 {{(pid=127196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:32:53.033553 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-0de0d3c2-a41a-48d6-aed0-512a5e980a0e tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] 10.222.0.23 "GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.113165 Sep 09 16:32:53.034629 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 83/170] 10.222.0.23 () {58 vars in 1275 bytes} [Fri Sep 9 16:32:52 2022] GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698/os-interface => generated 284 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:32:53.604185 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-5fe4946c-1f45-4849-aaac-069f9fd025ab tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:32:53.604656 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-5fe4946c-1f45-4849-aaac-069f9fd025ab tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] [instance: 4d413d7e-76c6-4b49-a7f0-ca29701c8817] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:32:53.620117 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5fe4946c-1f45-4849-aaac-069f9fd025ab tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:53.620857 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5fe4946c-1f45-4849-aaac-069f9fd025ab tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:53.621493 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5fe4946c-1f45-4849-aaac-069f9fd025ab tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:53.622381 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5fe4946c-1f45-4849-aaac-069f9fd025ab tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:53.623039 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5fe4946c-1f45-4849-aaac-069f9fd025ab tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:53.623649 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5fe4946c-1f45-4849-aaac-069f9fd025ab tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:53.697356 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-5fe4946c-1f45-4849-aaac-069f9fd025ab tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2fbc3668cf4a82b8eea0b67b87ca80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9243cdc25d5444d847db4f59c05fa6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:32:53.707680 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-5fe4946c-1f45-4849-aaac-069f9fd025ab tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] 10.222.0.23 "GET /compute/v2.1/servers/4d413d7e-76c6-4b49-a7f0-ca29701c8817" status: 200 len: 1272 microversion: 2.1 time: 0.107707 Sep 09 16:32:53.708419 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 88/171] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:32:53 2022] GET /compute/v2.1/servers/4d413d7e-76c6-4b49-a7f0-ca29701c8817 => generated 1272 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:32:53.830789 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-06769bd1-e71b-4f99-b830-76bfc0e6aca7 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:32:53.831398 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-06769bd1-e71b-4f99-b830-76bfc0e6aca7 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: e8d23cb3-2f39-4b00-ae9d-006e392a5940] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:32:53.850911 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-06769bd1-e71b-4f99-b830-76bfc0e6aca7 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:53.851498 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-06769bd1-e71b-4f99-b830-76bfc0e6aca7 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:53.851945 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-06769bd1-e71b-4f99-b830-76bfc0e6aca7 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:53.853043 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-06769bd1-e71b-4f99-b830-76bfc0e6aca7 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:53.853458 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-06769bd1-e71b-4f99-b830-76bfc0e6aca7 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:53.853883 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-06769bd1-e71b-4f99-b830-76bfc0e6aca7 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:53.959659 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-a92a9ed1-f697-4718-9e87-7bacec1f33d4 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "415da880-172f-4d8a-a206-bfb09fbfe59d"}} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:32:53.962164 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-a92a9ed1-f697-4718-9e87-7bacec1f33d4 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] [instance: 15d68c64-0569-4afa-a718-bc0e0c2cba3e] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:32:53.968548 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a92a9ed1-f697-4718-9e87-7bacec1f33d4 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:53.969336 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a92a9ed1-f697-4718-9e87-7bacec1f33d4 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:53.969960 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a92a9ed1-f697-4718-9e87-7bacec1f33d4 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:53.971042 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a92a9ed1-f697-4718-9e87-7bacec1f33d4 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:53.971714 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a92a9ed1-f697-4718-9e87-7bacec1f33d4 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:53.972275 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a92a9ed1-f697-4718-9e87-7bacec1f33d4 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:54.139641 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-06769bd1-e71b-4f99-b830-76bfc0e6aca7 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d86f09c6304121be2021cb5c15e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ab544d0b547919794e3efb49ba0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:32:54.151668 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-06769bd1-e71b-4f99-b830-76bfc0e6aca7 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940" status: 200 len: 1522 microversion: 2.1 time: 0.324859 Sep 09 16:32:54.152254 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 84/172] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:32:53 2022] GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940 => generated 1522 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 16:32:54.380466 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-a92a9ed1-f697-4718-9e87-7bacec1f33d4 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] 10.222.0.23 "POST /compute/v2.1/servers/15d68c64-0569-4afa-a718-bc0e0c2cba3e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.424830 Sep 09 16:32:54.381767 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 89/173] 10.222.0.23 () {60 vars in 1323 bytes} [Fri Sep 9 16:32:53 2022] POST /compute/v2.1/servers/15d68c64-0569-4afa-a718-bc0e0c2cba3e/os-volume_attachments => generated 194 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 16:32:54.733401 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-344782f3-32d8-4a3a-8767-09bf83cf6c87 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:32:54.734244 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-344782f3-32d8-4a3a-8767-09bf83cf6c87 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] [instance: 4d413d7e-76c6-4b49-a7f0-ca29701c8817] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:32:54.745804 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-344782f3-32d8-4a3a-8767-09bf83cf6c87 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:54.746581 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-344782f3-32d8-4a3a-8767-09bf83cf6c87 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:54.747266 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-344782f3-32d8-4a3a-8767-09bf83cf6c87 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:54.748025 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-344782f3-32d8-4a3a-8767-09bf83cf6c87 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:54.748657 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-344782f3-32d8-4a3a-8767-09bf83cf6c87 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:54.749085 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-344782f3-32d8-4a3a-8767-09bf83cf6c87 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:54.824748 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-344782f3-32d8-4a3a-8767-09bf83cf6c87 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2fbc3668cf4a82b8eea0b67b87ca80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9243cdc25d5444d847db4f59c05fa6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:32:54.835106 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-344782f3-32d8-4a3a-8767-09bf83cf6c87 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] 10.222.0.23 "GET /compute/v2.1/servers/4d413d7e-76c6-4b49-a7f0-ca29701c8817" status: 200 len: 1272 microversion: 2.1 time: 0.105808 Sep 09 16:32:54.836012 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 85/174] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:32:54 2022] GET /compute/v2.1/servers/4d413d7e-76c6-4b49-a7f0-ca29701c8817 => generated 1272 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:32:55.177664 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-71fdd0dc-b2a8-4033-8260-719acc4a99c8 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:32:55.178336 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-71fdd0dc-b2a8-4033-8260-719acc4a99c8 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: e8d23cb3-2f39-4b00-ae9d-006e392a5940] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:32:55.189549 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-71fdd0dc-b2a8-4033-8260-719acc4a99c8 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:55.190040 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-71fdd0dc-b2a8-4033-8260-719acc4a99c8 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:55.190462 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-71fdd0dc-b2a8-4033-8260-719acc4a99c8 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:55.191191 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-71fdd0dc-b2a8-4033-8260-719acc4a99c8 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:55.191629 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-71fdd0dc-b2a8-4033-8260-719acc4a99c8 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:55.192109 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-71fdd0dc-b2a8-4033-8260-719acc4a99c8 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:55.229856 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [req-449de004-e4d1-4b63-86bc-e4ebd4969e34 req-1c79a10c-4413-41af-bde6-2edbf9d77e07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e761961-9c74-444c-bb4b-0b2f82a9d698", "tag": "a26fe3a3-c8fd-45e4-8105-8c34395addd8"}]} {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:32:55.246616 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [req-449de004-e4d1-4b63-86bc-e4ebd4969e34 req-1c79a10c-4413-41af-bde6-2edbf9d77e07 service nova] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:55.251113 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [req-449de004-e4d1-4b63-86bc-e4ebd4969e34 req-1c79a10c-4413-41af-bde6-2edbf9d77e07 service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:55.251766 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [req-449de004-e4d1-4b63-86bc-e4ebd4969e34 req-1c79a10c-4413-41af-bde6-2edbf9d77e07 service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:55.267017 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.compute.server_external_events [req-449de004-e4d1-4b63-86bc-e4ebd4969e34 req-1c79a10c-4413-41af-bde6-2edbf9d77e07 service nova] Creating event network-changed:a26fe3a3-c8fd-45e4-8105-8c34395addd8 for instance 9e761961-9c74-444c-bb4b-0b2f82a9d698 on hv-cinder-83124 Sep 09 16:32:55.275133 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [req-449de004-e4d1-4b63-86bc-e4ebd4969e34 req-1c79a10c-4413-41af-bde6-2edbf9d77e07 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049220 Sep 09 16:32:55.276291 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 86/175] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Sep 9 16:32:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 16:32:55.345086 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-71fdd0dc-b2a8-4033-8260-719acc4a99c8 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d86f09c6304121be2021cb5c15e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ab544d0b547919794e3efb49ba0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:32:55.353001 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-71fdd0dc-b2a8-4033-8260-719acc4a99c8 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940" status: 200 len: 1522 microversion: 2.1 time: 0.181635 Sep 09 16:32:55.353569 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 90/176] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:32:55 2022] GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940 => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:32:55.871083 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-f122a287-b6d7-4020-9516-ee88fba1f08f tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:32:55.872922 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-f122a287-b6d7-4020-9516-ee88fba1f08f tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] [instance: 4d413d7e-76c6-4b49-a7f0-ca29701c8817] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:32:55.879326 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f122a287-b6d7-4020-9516-ee88fba1f08f tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:55.880054 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f122a287-b6d7-4020-9516-ee88fba1f08f tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:55.880663 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f122a287-b6d7-4020-9516-ee88fba1f08f tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:55.881498 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f122a287-b6d7-4020-9516-ee88fba1f08f tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:55.882225 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f122a287-b6d7-4020-9516-ee88fba1f08f tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:55.882804 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f122a287-b6d7-4020-9516-ee88fba1f08f tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:56.091448 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-f122a287-b6d7-4020-9516-ee88fba1f08f tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2fbc3668cf4a82b8eea0b67b87ca80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9243cdc25d5444d847db4f59c05fa6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:32:56.103506 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-f122a287-b6d7-4020-9516-ee88fba1f08f tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] 10.222.0.23 "GET /compute/v2.1/servers/4d413d7e-76c6-4b49-a7f0-ca29701c8817" status: 200 len: 1314 microversion: 2.1 time: 0.236590 Sep 09 16:32:56.104733 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 87/177] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:32:55 2022] GET /compute/v2.1/servers/4d413d7e-76c6-4b49-a7f0-ca29701c8817 => generated 1314 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:32:56.376321 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-40c68093-194a-4d56-a8d5-a0419a6b4daa tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:32:56.376916 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-40c68093-194a-4d56-a8d5-a0419a6b4daa tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: e8d23cb3-2f39-4b00-ae9d-006e392a5940] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:32:56.383605 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-40c68093-194a-4d56-a8d5-a0419a6b4daa tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:56.384329 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-40c68093-194a-4d56-a8d5-a0419a6b4daa tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:56.384860 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-40c68093-194a-4d56-a8d5-a0419a6b4daa tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:56.385826 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-40c68093-194a-4d56-a8d5-a0419a6b4daa tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:56.386482 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-40c68093-194a-4d56-a8d5-a0419a6b4daa tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:56.387032 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-40c68093-194a-4d56-a8d5-a0419a6b4daa tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:56.608477 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-40c68093-194a-4d56-a8d5-a0419a6b4daa tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d86f09c6304121be2021cb5c15e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ab544d0b547919794e3efb49ba0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:32:56.618212 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-40c68093-194a-4d56-a8d5-a0419a6b4daa tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940" status: 200 len: 1522 microversion: 2.1 time: 0.245416 Sep 09 16:32:56.618934 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 91/178] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:32:56 2022] GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940 => generated 1522 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:32:57.127586 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-6260e82c-9182-4875-bb85-867f0b79b105 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:32:57.128796 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-6260e82c-9182-4875-bb85-867f0b79b105 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] [instance: 4d413d7e-76c6-4b49-a7f0-ca29701c8817] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:32:57.135017 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-6260e82c-9182-4875-bb85-867f0b79b105 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:57.135499 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-6260e82c-9182-4875-bb85-867f0b79b105 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:57.135928 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-6260e82c-9182-4875-bb85-867f0b79b105 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:57.136761 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-6260e82c-9182-4875-bb85-867f0b79b105 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:57.137324 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-6260e82c-9182-4875-bb85-867f0b79b105 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:57.137755 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-6260e82c-9182-4875-bb85-867f0b79b105 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:57.283864 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-6260e82c-9182-4875-bb85-867f0b79b105 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2fbc3668cf4a82b8eea0b67b87ca80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9243cdc25d5444d847db4f59c05fa6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:32:57.294054 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [req-2b7e3da9-5d04-4cd2-acdc-2451c5f840f4 req-392ce283-2c6b-43c4-9b88-48b847480a97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d413d7e-76c6-4b49-a7f0-ca29701c8817", "tag": "4a5d83c8-b468-433b-8288-e90339b62fc3"}]} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:32:57.294717 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-6260e82c-9182-4875-bb85-867f0b79b105 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] 10.222.0.23 "GET /compute/v2.1/servers/4d413d7e-76c6-4b49-a7f0-ca29701c8817" status: 200 len: 1314 microversion: 2.1 time: 0.172038 Sep 09 16:32:57.295751 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 88/179] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:32:57 2022] GET /compute/v2.1/servers/4d413d7e-76c6-4b49-a7f0-ca29701c8817 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:32:57.314096 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-2b7e3da9-5d04-4cd2-acdc-2451c5f840f4 req-392ce283-2c6b-43c4-9b88-48b847480a97 service nova] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:57.314616 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-2b7e3da9-5d04-4cd2-acdc-2451c5f840f4 req-392ce283-2c6b-43c4-9b88-48b847480a97 service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:57.315038 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-2b7e3da9-5d04-4cd2-acdc-2451c5f840f4 req-392ce283-2c6b-43c4-9b88-48b847480a97 service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:57.326664 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.compute.server_external_events [req-2b7e3da9-5d04-4cd2-acdc-2451c5f840f4 req-392ce283-2c6b-43c4-9b88-48b847480a97 service nova] Creating event network-changed:4a5d83c8-b468-433b-8288-e90339b62fc3 for instance 4d413d7e-76c6-4b49-a7f0-ca29701c8817 on hv-cinder-83124 Sep 09 16:32:57.331913 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [req-2b7e3da9-5d04-4cd2-acdc-2451c5f840f4 req-392ce283-2c6b-43c4-9b88-48b847480a97 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041443 Sep 09 16:32:57.332578 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 92/180] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Sep 9 16:32:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 16:32:57.643292 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-584c7037-9182-4c21-a963-4e21e604d1ed tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:32:57.644663 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-584c7037-9182-4c21-a963-4e21e604d1ed tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: e8d23cb3-2f39-4b00-ae9d-006e392a5940] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:32:57.652640 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-584c7037-9182-4c21-a963-4e21e604d1ed tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:57.653302 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-584c7037-9182-4c21-a963-4e21e604d1ed tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:57.653821 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-584c7037-9182-4c21-a963-4e21e604d1ed tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:57.654639 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-584c7037-9182-4c21-a963-4e21e604d1ed tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:57.655142 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-584c7037-9182-4c21-a963-4e21e604d1ed tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:57.655564 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-584c7037-9182-4c21-a963-4e21e604d1ed tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:57.795173 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-584c7037-9182-4c21-a963-4e21e604d1ed tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d86f09c6304121be2021cb5c15e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ab544d0b547919794e3efb49ba0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:32:57.804068 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-584c7037-9182-4c21-a963-4e21e604d1ed tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940" status: 200 len: 1522 microversion: 2.1 time: 0.165986 Sep 09 16:32:57.804707 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 89/181] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:32:57 2022] GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 16:32:58.318607 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-6ba40211-5f70-44d3-b65a-b5ca2aed06d4 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:32:58.319299 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-6ba40211-5f70-44d3-b65a-b5ca2aed06d4 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] [instance: 4d413d7e-76c6-4b49-a7f0-ca29701c8817] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:32:58.327080 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6ba40211-5f70-44d3-b65a-b5ca2aed06d4 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:58.327867 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6ba40211-5f70-44d3-b65a-b5ca2aed06d4 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:58.328662 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6ba40211-5f70-44d3-b65a-b5ca2aed06d4 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:58.329672 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6ba40211-5f70-44d3-b65a-b5ca2aed06d4 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:58.330369 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6ba40211-5f70-44d3-b65a-b5ca2aed06d4 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:58.331030 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6ba40211-5f70-44d3-b65a-b5ca2aed06d4 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:58.469995 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-6ba40211-5f70-44d3-b65a-b5ca2aed06d4 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2fbc3668cf4a82b8eea0b67b87ca80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9243cdc25d5444d847db4f59c05fa6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:32:58.477941 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-6ba40211-5f70-44d3-b65a-b5ca2aed06d4 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] 10.222.0.23 "GET /compute/v2.1/servers/4d413d7e-76c6-4b49-a7f0-ca29701c8817" status: 200 len: 1314 microversion: 2.1 time: 0.164273 Sep 09 16:32:58.478758 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 93/182] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:32:58 2022] GET /compute/v2.1/servers/4d413d7e-76c6-4b49-a7f0-ca29701c8817 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 16:32:58.833545 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-fdc793e4-f168-407e-a98a-d9c576505799 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:32:58.834130 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-fdc793e4-f168-407e-a98a-d9c576505799 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: e8d23cb3-2f39-4b00-ae9d-006e392a5940] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:32:58.841284 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-fdc793e4-f168-407e-a98a-d9c576505799 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:58.841811 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-fdc793e4-f168-407e-a98a-d9c576505799 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:58.842249 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-fdc793e4-f168-407e-a98a-d9c576505799 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:58.843094 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-fdc793e4-f168-407e-a98a-d9c576505799 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:58.843608 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-fdc793e4-f168-407e-a98a-d9c576505799 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:58.844071 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-fdc793e4-f168-407e-a98a-d9c576505799 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:58.993255 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-fdc793e4-f168-407e-a98a-d9c576505799 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d86f09c6304121be2021cb5c15e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ab544d0b547919794e3efb49ba0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:32:59.001372 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-fdc793e4-f168-407e-a98a-d9c576505799 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940" status: 200 len: 1522 microversion: 2.1 time: 0.174542 Sep 09 16:32:59.001935 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 90/183] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:32:58 2022] GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940 => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:32:59.503446 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-e3f4b354-a426-4649-a63b-ca30ffe1a514 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:32:59.504321 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-e3f4b354-a426-4649-a63b-ca30ffe1a514 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] [instance: 4d413d7e-76c6-4b49-a7f0-ca29701c8817] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:32:59.516893 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e3f4b354-a426-4649-a63b-ca30ffe1a514 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:59.519026 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e3f4b354-a426-4649-a63b-ca30ffe1a514 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:59.519864 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e3f4b354-a426-4649-a63b-ca30ffe1a514 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:59.521192 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e3f4b354-a426-4649-a63b-ca30ffe1a514 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:32:59.521970 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e3f4b354-a426-4649-a63b-ca30ffe1a514 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:32:59.522955 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e3f4b354-a426-4649-a63b-ca30ffe1a514 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:32:59.731138 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-e3f4b354-a426-4649-a63b-ca30ffe1a514 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2fbc3668cf4a82b8eea0b67b87ca80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9243cdc25d5444d847db4f59c05fa6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:32:59.742021 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-e3f4b354-a426-4649-a63b-ca30ffe1a514 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] 10.222.0.23 "GET /compute/v2.1/servers/4d413d7e-76c6-4b49-a7f0-ca29701c8817" status: 200 len: 1314 microversion: 2.1 time: 0.245007 Sep 09 16:32:59.757248 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 94/184] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:32:59 2022] GET /compute/v2.1/servers/4d413d7e-76c6-4b49-a7f0-ca29701c8817 => generated 1314 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:33:00.024590 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-b185bb1d-57ad-4184-9245-cb744d7e53fa tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:33:00.025184 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-b185bb1d-57ad-4184-9245-cb744d7e53fa tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: e8d23cb3-2f39-4b00-ae9d-006e392a5940] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:33:00.028187 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG dbcounter [-] [127196] Writing DB stats nova_cell0:SELECT=2 {{(pid=127196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:33:00.028920 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG dbcounter [-] [127196] Writing DB stats nova_cell0:SELECT=6 {{(pid=127196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:33:00.032921 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-b185bb1d-57ad-4184-9245-cb744d7e53fa tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:00.033399 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-b185bb1d-57ad-4184-9245-cb744d7e53fa tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:00.033826 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-b185bb1d-57ad-4184-9245-cb744d7e53fa tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:00.034536 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-b185bb1d-57ad-4184-9245-cb744d7e53fa tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:00.034990 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-b185bb1d-57ad-4184-9245-cb744d7e53fa tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:00.035412 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-b185bb1d-57ad-4184-9245-cb744d7e53fa tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:00.180056 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-b185bb1d-57ad-4184-9245-cb744d7e53fa tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d86f09c6304121be2021cb5c15e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ab544d0b547919794e3efb49ba0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:33:00.188000 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-b185bb1d-57ad-4184-9245-cb744d7e53fa tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940" status: 200 len: 1522 microversion: 2.1 time: 0.167172 Sep 09 16:33:00.188784 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 91/185] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:33:00 2022] GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:33:00.764589 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-2e4d4589-30f5-42dc-b6ae-7dfc2da77cf5 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:33:00.765188 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-2e4d4589-30f5-42dc-b6ae-7dfc2da77cf5 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] [instance: 4d413d7e-76c6-4b49-a7f0-ca29701c8817] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:33:00.767194 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell0:SELECT=2 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:33:00.773227 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2e4d4589-30f5-42dc-b6ae-7dfc2da77cf5 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:00.773698 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2e4d4589-30f5-42dc-b6ae-7dfc2da77cf5 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:00.774138 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2e4d4589-30f5-42dc-b6ae-7dfc2da77cf5 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:00.774846 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2e4d4589-30f5-42dc-b6ae-7dfc2da77cf5 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:00.775287 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2e4d4589-30f5-42dc-b6ae-7dfc2da77cf5 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:00.775679 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2e4d4589-30f5-42dc-b6ae-7dfc2da77cf5 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:00.968032 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-2e4d4589-30f5-42dc-b6ae-7dfc2da77cf5 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2fbc3668cf4a82b8eea0b67b87ca80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9243cdc25d5444d847db4f59c05fa6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:33:00.976229 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-2e4d4589-30f5-42dc-b6ae-7dfc2da77cf5 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] 10.222.0.23 "GET /compute/v2.1/servers/4d413d7e-76c6-4b49-a7f0-ca29701c8817" status: 200 len: 1314 microversion: 2.1 time: 0.215621 Sep 09 16:33:00.976815 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 95/186] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:33:00 2022] GET /compute/v2.1/servers/4d413d7e-76c6-4b49-a7f0-ca29701c8817 => generated 1314 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:33:01.209958 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-455538c3-5cf6-46e2-b6f8-9068b55f9125 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:33:01.211166 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-455538c3-5cf6-46e2-b6f8-9068b55f9125 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: e8d23cb3-2f39-4b00-ae9d-006e392a5940] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:33:01.223472 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-455538c3-5cf6-46e2-b6f8-9068b55f9125 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:01.223472 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-455538c3-5cf6-46e2-b6f8-9068b55f9125 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:01.223472 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-455538c3-5cf6-46e2-b6f8-9068b55f9125 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:01.223472 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-455538c3-5cf6-46e2-b6f8-9068b55f9125 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:01.223831 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-455538c3-5cf6-46e2-b6f8-9068b55f9125 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:01.223831 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-455538c3-5cf6-46e2-b6f8-9068b55f9125 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:01.349775 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-455538c3-5cf6-46e2-b6f8-9068b55f9125 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d86f09c6304121be2021cb5c15e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ab544d0b547919794e3efb49ba0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:33:01.357765 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-455538c3-5cf6-46e2-b6f8-9068b55f9125 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940" status: 200 len: 1522 microversion: 2.1 time: 0.151854 Sep 09 16:33:01.358346 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 92/187] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:33:01 2022] GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:33:01.999374 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-8aec452a-4f84-4583-b6a8-99410b58259d tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:33:02.000121 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-8aec452a-4f84-4583-b6a8-99410b58259d tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] [instance: 4d413d7e-76c6-4b49-a7f0-ca29701c8817] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:33:02.007306 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8aec452a-4f84-4583-b6a8-99410b58259d tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:02.007849 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8aec452a-4f84-4583-b6a8-99410b58259d tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:02.008686 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8aec452a-4f84-4583-b6a8-99410b58259d tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:02.009735 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8aec452a-4f84-4583-b6a8-99410b58259d tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:02.010450 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8aec452a-4f84-4583-b6a8-99410b58259d tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:02.011035 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8aec452a-4f84-4583-b6a8-99410b58259d tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:02.146935 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-8aec452a-4f84-4583-b6a8-99410b58259d tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2fbc3668cf4a82b8eea0b67b87ca80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9243cdc25d5444d847db4f59c05fa6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:33:02.155145 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-8aec452a-4f84-4583-b6a8-99410b58259d tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] 10.222.0.23 "GET /compute/v2.1/servers/4d413d7e-76c6-4b49-a7f0-ca29701c8817" status: 200 len: 1314 microversion: 2.1 time: 0.159898 Sep 09 16:33:02.155764 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 96/188] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:33:01 2022] GET /compute/v2.1/servers/4d413d7e-76c6-4b49-a7f0-ca29701c8817 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 16:33:02.381105 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-e73315b6-de7e-48bd-9b6d-d6fda5f7df28 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:33:02.381724 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-e73315b6-de7e-48bd-9b6d-d6fda5f7df28 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: e8d23cb3-2f39-4b00-ae9d-006e392a5940] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:33:02.387885 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e73315b6-de7e-48bd-9b6d-d6fda5f7df28 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:02.388368 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e73315b6-de7e-48bd-9b6d-d6fda5f7df28 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:02.388800 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e73315b6-de7e-48bd-9b6d-d6fda5f7df28 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:02.389477 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e73315b6-de7e-48bd-9b6d-d6fda5f7df28 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:02.390120 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e73315b6-de7e-48bd-9b6d-d6fda5f7df28 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:02.390559 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e73315b6-de7e-48bd-9b6d-d6fda5f7df28 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:02.520751 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-e73315b6-de7e-48bd-9b6d-d6fda5f7df28 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d86f09c6304121be2021cb5c15e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ab544d0b547919794e3efb49ba0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:33:02.529010 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-e73315b6-de7e-48bd-9b6d-d6fda5f7df28 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940" status: 200 len: 1522 microversion: 2.1 time: 0.152090 Sep 09 16:33:02.529618 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 93/189] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:33:02 2022] GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:33:03.177972 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-5c240754-af0e-4952-b02b-b0955b0c40c5 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:33:03.178638 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-5c240754-af0e-4952-b02b-b0955b0c40c5 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] [instance: 4d413d7e-76c6-4b49-a7f0-ca29701c8817] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:33:03.186852 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5c240754-af0e-4952-b02b-b0955b0c40c5 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:03.187335 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5c240754-af0e-4952-b02b-b0955b0c40c5 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:03.187825 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5c240754-af0e-4952-b02b-b0955b0c40c5 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:03.188503 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5c240754-af0e-4952-b02b-b0955b0c40c5 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:03.188911 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5c240754-af0e-4952-b02b-b0955b0c40c5 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:03.189315 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5c240754-af0e-4952-b02b-b0955b0c40c5 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:03.324850 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-5c240754-af0e-4952-b02b-b0955b0c40c5 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2fbc3668cf4a82b8eea0b67b87ca80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9243cdc25d5444d847db4f59c05fa6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:33:03.335714 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-5c240754-af0e-4952-b02b-b0955b0c40c5 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] 10.222.0.23 "GET /compute/v2.1/servers/4d413d7e-76c6-4b49-a7f0-ca29701c8817" status: 200 len: 1314 microversion: 2.1 time: 0.161860 Sep 09 16:33:03.351336 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 97/190] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:33:03 2022] GET /compute/v2.1/servers/4d413d7e-76c6-4b49-a7f0-ca29701c8817 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:33:03.552078 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-e6657796-1f8c-42c9-9474-f858eede322f tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:33:03.552897 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-e6657796-1f8c-42c9-9474-f858eede322f tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: e8d23cb3-2f39-4b00-ae9d-006e392a5940] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:33:03.559093 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e6657796-1f8c-42c9-9474-f858eede322f tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:03.559571 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e6657796-1f8c-42c9-9474-f858eede322f tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:03.560006 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e6657796-1f8c-42c9-9474-f858eede322f tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:03.560669 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e6657796-1f8c-42c9-9474-f858eede322f tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:03.561117 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e6657796-1f8c-42c9-9474-f858eede322f tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:03.561530 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e6657796-1f8c-42c9-9474-f858eede322f tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:03.696284 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-e6657796-1f8c-42c9-9474-f858eede322f tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d86f09c6304121be2021cb5c15e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ab544d0b547919794e3efb49ba0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:33:03.704112 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-e6657796-1f8c-42c9-9474-f858eede322f tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940" status: 200 len: 1522 microversion: 2.1 time: 0.156339 Sep 09 16:33:03.704711 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 94/191] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:33:03 2022] GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:33:03.782668 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [req-8d9895d1-4c16-4f45-8f1d-6b823898c93d req-1ddfebbd-cb3e-455b-aa5e-53c5dbdc5cb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d413d7e-76c6-4b49-a7f0-ca29701c8817", "name": "network-vif-plugged", "status": "completed", "tag": "4a5d83c8-b468-433b-8288-e90339b62fc3"}]} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:33:03.792547 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-8d9895d1-4c16-4f45-8f1d-6b823898c93d req-1ddfebbd-cb3e-455b-aa5e-53c5dbdc5cb7 service nova] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:03.793022 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-8d9895d1-4c16-4f45-8f1d-6b823898c93d req-1ddfebbd-cb3e-455b-aa5e-53c5dbdc5cb7 service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:03.793457 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-8d9895d1-4c16-4f45-8f1d-6b823898c93d req-1ddfebbd-cb3e-455b-aa5e-53c5dbdc5cb7 service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:03.805417 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.compute.server_external_events [req-8d9895d1-4c16-4f45-8f1d-6b823898c93d req-1ddfebbd-cb3e-455b-aa5e-53c5dbdc5cb7 service nova] Creating event network-vif-plugged:4a5d83c8-b468-433b-8288-e90339b62fc3 for instance 4d413d7e-76c6-4b49-a7f0-ca29701c8817 on hv-cinder-83124 Sep 09 16:33:03.810580 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [req-8d9895d1-4c16-4f45-8f1d-6b823898c93d req-1ddfebbd-cb3e-455b-aa5e-53c5dbdc5cb7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031666 Sep 09 16:33:03.811335 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 98/192] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Sep 9 16:33:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:33:04.362237 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-4e7ac4af-6755-4b65-bce9-f97e84e7953f tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:33:04.363293 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-4e7ac4af-6755-4b65-bce9-f97e84e7953f tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] [instance: 4d413d7e-76c6-4b49-a7f0-ca29701c8817] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:33:04.373434 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-4e7ac4af-6755-4b65-bce9-f97e84e7953f tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:04.374194 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-4e7ac4af-6755-4b65-bce9-f97e84e7953f tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:04.374981 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-4e7ac4af-6755-4b65-bce9-f97e84e7953f tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:04.376103 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-4e7ac4af-6755-4b65-bce9-f97e84e7953f tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:04.376850 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-4e7ac4af-6755-4b65-bce9-f97e84e7953f tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:04.377545 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-4e7ac4af-6755-4b65-bce9-f97e84e7953f tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:04.515659 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-4e7ac4af-6755-4b65-bce9-f97e84e7953f tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2fbc3668cf4a82b8eea0b67b87ca80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9243cdc25d5444d847db4f59c05fa6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:33:04.523747 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-4e7ac4af-6755-4b65-bce9-f97e84e7953f tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] 10.222.0.23 "GET /compute/v2.1/servers/4d413d7e-76c6-4b49-a7f0-ca29701c8817" status: 200 len: 1314 microversion: 2.1 time: 0.167940 Sep 09 16:33:04.524309 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 95/193] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:33:04 2022] GET /compute/v2.1/servers/4d413d7e-76c6-4b49-a7f0-ca29701c8817 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:33:04.727677 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-e32b0d8c-5f99-4f7d-a91d-81378824d58e tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:33:04.728232 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-e32b0d8c-5f99-4f7d-a91d-81378824d58e tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: e8d23cb3-2f39-4b00-ae9d-006e392a5940] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:33:04.734394 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e32b0d8c-5f99-4f7d-a91d-81378824d58e tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:04.734897 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e32b0d8c-5f99-4f7d-a91d-81378824d58e tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:04.735318 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e32b0d8c-5f99-4f7d-a91d-81378824d58e tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:04.735993 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e32b0d8c-5f99-4f7d-a91d-81378824d58e tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:04.736435 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e32b0d8c-5f99-4f7d-a91d-81378824d58e tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:04.736846 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e32b0d8c-5f99-4f7d-a91d-81378824d58e tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:04.878220 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-e32b0d8c-5f99-4f7d-a91d-81378824d58e tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d86f09c6304121be2021cb5c15e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ab544d0b547919794e3efb49ba0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:33:04.886096 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-e32b0d8c-5f99-4f7d-a91d-81378824d58e tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940" status: 200 len: 1522 microversion: 2.1 time: 0.163283 Sep 09 16:33:04.886691 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 99/194] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:33:04 2022] GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:33:05.561068 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-c087f065-3e7f-4004-ba5b-c3fd871ab6c4 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:33:05.561738 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-c087f065-3e7f-4004-ba5b-c3fd871ab6c4 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] [instance: 4d413d7e-76c6-4b49-a7f0-ca29701c8817] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:33:05.568692 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-c087f065-3e7f-4004-ba5b-c3fd871ab6c4 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:05.570565 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-c087f065-3e7f-4004-ba5b-c3fd871ab6c4 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:05.571150 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-c087f065-3e7f-4004-ba5b-c3fd871ab6c4 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:05.571915 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-c087f065-3e7f-4004-ba5b-c3fd871ab6c4 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:05.572364 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-c087f065-3e7f-4004-ba5b-c3fd871ab6c4 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:05.572779 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-c087f065-3e7f-4004-ba5b-c3fd871ab6c4 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:05.716306 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-c087f065-3e7f-4004-ba5b-c3fd871ab6c4 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2fbc3668cf4a82b8eea0b67b87ca80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9243cdc25d5444d847db4f59c05fa6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:33:05.724293 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-c087f065-3e7f-4004-ba5b-c3fd871ab6c4 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] 10.222.0.23 "GET /compute/v2.1/servers/4d413d7e-76c6-4b49-a7f0-ca29701c8817" status: 200 len: 1314 microversion: 2.1 time: 0.168659 Sep 09 16:33:05.724857 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 96/195] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:33:05 2022] GET /compute/v2.1/servers/4d413d7e-76c6-4b49-a7f0-ca29701c8817 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:33:05.908497 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-17d73a4d-6bb9-4b9f-97fa-fa5de32cf0e7 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:33:05.909126 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-17d73a4d-6bb9-4b9f-97fa-fa5de32cf0e7 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: e8d23cb3-2f39-4b00-ae9d-006e392a5940] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:33:05.926197 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-17d73a4d-6bb9-4b9f-97fa-fa5de32cf0e7 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:05.927635 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-17d73a4d-6bb9-4b9f-97fa-fa5de32cf0e7 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:05.928356 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-17d73a4d-6bb9-4b9f-97fa-fa5de32cf0e7 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:05.929277 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-17d73a4d-6bb9-4b9f-97fa-fa5de32cf0e7 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:05.929747 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-17d73a4d-6bb9-4b9f-97fa-fa5de32cf0e7 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:05.930407 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-17d73a4d-6bb9-4b9f-97fa-fa5de32cf0e7 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:06.115886 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-17d73a4d-6bb9-4b9f-97fa-fa5de32cf0e7 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d86f09c6304121be2021cb5c15e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ab544d0b547919794e3efb49ba0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:33:06.123920 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-17d73a4d-6bb9-4b9f-97fa-fa5de32cf0e7 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940" status: 200 len: 1522 microversion: 2.1 time: 0.219391 Sep 09 16:33:06.124656 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 100/196] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:33:05 2022] GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940 => generated 1522 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:33:06.628144 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-e1a36207-d047-441a-b7b5-18c9185f5711 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:33:06.628666 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-e1a36207-d047-441a-b7b5-18c9185f5711 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] [instance: 15d68c64-0569-4afa-a718-bc0e0c2cba3e] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:33:06.635266 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e1a36207-d047-441a-b7b5-18c9185f5711 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:06.635793 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e1a36207-d047-441a-b7b5-18c9185f5711 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:06.636279 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e1a36207-d047-441a-b7b5-18c9185f5711 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:06.637021 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e1a36207-d047-441a-b7b5-18c9185f5711 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:06.637454 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e1a36207-d047-441a-b7b5-18c9185f5711 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:06.637867 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e1a36207-d047-441a-b7b5-18c9185f5711 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:06.662480 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-e1a36207-d047-441a-b7b5-18c9185f5711 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] [instance: 15d68c64-0569-4afa-a718-bc0e0c2cba3e] Going to try to terminate instance {{(pid=127196) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 16:33:06.746734 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-6575125d-8f50-418f-b772-648a01e58d61 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:33:06.747273 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-6575125d-8f50-418f-b772-648a01e58d61 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] [instance: 4d413d7e-76c6-4b49-a7f0-ca29701c8817] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:33:06.753712 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6575125d-8f50-418f-b772-648a01e58d61 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:06.754046 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-e1a36207-d047-441a-b7b5-18c9185f5711 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] 10.222.0.23 "DELETE /compute/v2.1/servers/15d68c64-0569-4afa-a718-bc0e0c2cba3e" status: 204 len: 0 microversion: 2.1 time: 0.129474 Sep 09 16:33:06.754237 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6575125d-8f50-418f-b772-648a01e58d61 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:06.754647 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6575125d-8f50-418f-b772-648a01e58d61 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:06.754915 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 97/197] 10.222.0.23 () {58 vars in 1239 bytes} [Fri Sep 9 16:33:06 2022] DELETE /compute/v2.1/servers/15d68c64-0569-4afa-a718-bc0e0c2cba3e => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 16:33:06.755347 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6575125d-8f50-418f-b772-648a01e58d61 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:06.755848 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6575125d-8f50-418f-b772-648a01e58d61 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:06.756262 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6575125d-8f50-418f-b772-648a01e58d61 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:06.764099 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-8724c980-1dca-46b3-aa87-728a40e2a9a0 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:33:06.764925 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-8724c980-1dca-46b3-aa87-728a40e2a9a0 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] [instance: 15d68c64-0569-4afa-a718-bc0e0c2cba3e] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:33:06.772002 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-8724c980-1dca-46b3-aa87-728a40e2a9a0 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:06.772563 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-8724c980-1dca-46b3-aa87-728a40e2a9a0 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:06.773059 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-8724c980-1dca-46b3-aa87-728a40e2a9a0 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:06.773815 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-8724c980-1dca-46b3-aa87-728a40e2a9a0 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:06.774335 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-8724c980-1dca-46b3-aa87-728a40e2a9a0 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:06.774864 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-8724c980-1dca-46b3-aa87-728a40e2a9a0 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:06.956147 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-6575125d-8f50-418f-b772-648a01e58d61 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2fbc3668cf4a82b8eea0b67b87ca80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9243cdc25d5444d847db4f59c05fa6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:33:06.963079 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:33:06.966139 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-8724c980-1dca-46b3-aa87-728a40e2a9a0 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce1cd9c19584549b794df8e487abf00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f227ee89ce84dec84410a1db9b479fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:33:06.969139 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-6575125d-8f50-418f-b772-648a01e58d61 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] 10.222.0.23 "GET /compute/v2.1/servers/4d413d7e-76c6-4b49-a7f0-ca29701c8817" status: 200 len: 1314 microversion: 2.1 time: 0.226264 Sep 09 16:33:06.980231 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-8724c980-1dca-46b3-aa87-728a40e2a9a0 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] 10.222.0.23 "GET /compute/v2.1/servers/15d68c64-0569-4afa-a718-bc0e0c2cba3e" status: 200 len: 1552 microversion: 2.1 time: 0.215395 Sep 09 16:33:06.980231 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 98/198] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:33:06 2022] GET /compute/v2.1/servers/15d68c64-0569-4afa-a718-bc0e0c2cba3e => generated 1552 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:33:06.986612 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 101/199] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:33:06 2022] GET /compute/v2.1/servers/4d413d7e-76c6-4b49-a7f0-ca29701c8817 => generated 1314 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:33:07.146557 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-b4862a48-bbe1-4ff0-ba6a-635486b78c34 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:33:07.147812 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-b4862a48-bbe1-4ff0-ba6a-635486b78c34 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: e8d23cb3-2f39-4b00-ae9d-006e392a5940] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:33:07.155386 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-b4862a48-bbe1-4ff0-ba6a-635486b78c34 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:07.155386 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-b4862a48-bbe1-4ff0-ba6a-635486b78c34 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:07.155865 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-b4862a48-bbe1-4ff0-ba6a-635486b78c34 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:07.156752 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-b4862a48-bbe1-4ff0-ba6a-635486b78c34 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:07.157724 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-b4862a48-bbe1-4ff0-ba6a-635486b78c34 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:07.158629 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-b4862a48-bbe1-4ff0-ba6a-635486b78c34 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:07.186413 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG dbcounter [-] [127196] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:33:07.292330 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-b4862a48-bbe1-4ff0-ba6a-635486b78c34 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d86f09c6304121be2021cb5c15e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ab544d0b547919794e3efb49ba0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:33:07.300427 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-b4862a48-bbe1-4ff0-ba6a-635486b78c34 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940" status: 200 len: 1522 microversion: 2.1 time: 0.157917 Sep 09 16:33:07.301007 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 99/200] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:33:07 2022] GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:33:07.997045 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-52628601-b014-44f7-85f8-f1d0334e7bd6 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:33:07.997638 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-85654cbe-c471-4bfe-884f-ea4b1ae891b5 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:33:07.998032 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-52628601-b014-44f7-85f8-f1d0334e7bd6 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] [instance: 15d68c64-0569-4afa-a718-bc0e0c2cba3e] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:33:07.998124 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-85654cbe-c471-4bfe-884f-ea4b1ae891b5 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] [instance: 4d413d7e-76c6-4b49-a7f0-ca29701c8817] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:33:08.003971 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-52628601-b014-44f7-85f8-f1d0334e7bd6 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:08.004419 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-52628601-b014-44f7-85f8-f1d0334e7bd6 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:08.004834 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-52628601-b014-44f7-85f8-f1d0334e7bd6 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:08.007293 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-52628601-b014-44f7-85f8-f1d0334e7bd6 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:08.007414 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-85654cbe-c471-4bfe-884f-ea4b1ae891b5 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:08.007504 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-52628601-b014-44f7-85f8-f1d0334e7bd6 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:08.007576 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-85654cbe-c471-4bfe-884f-ea4b1ae891b5 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:08.007652 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-52628601-b014-44f7-85f8-f1d0334e7bd6 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:08.007735 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-85654cbe-c471-4bfe-884f-ea4b1ae891b5 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:08.007888 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-85654cbe-c471-4bfe-884f-ea4b1ae891b5 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:08.008412 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-85654cbe-c471-4bfe-884f-ea4b1ae891b5 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:08.008933 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-85654cbe-c471-4bfe-884f-ea4b1ae891b5 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:08.213644 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-52628601-b014-44f7-85f8-f1d0334e7bd6 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce1cd9c19584549b794df8e487abf00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f227ee89ce84dec84410a1db9b479fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:33:08.222989 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-85654cbe-c471-4bfe-884f-ea4b1ae891b5 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2fbc3668cf4a82b8eea0b67b87ca80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9243cdc25d5444d847db4f59c05fa6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:33:08.230956 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-52628601-b014-44f7-85f8-f1d0334e7bd6 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] 10.222.0.23 "GET /compute/v2.1/servers/15d68c64-0569-4afa-a718-bc0e0c2cba3e" status: 200 len: 1552 microversion: 2.1 time: 0.237618 Sep 09 16:33:08.231691 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 100/201] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:33:07 2022] GET /compute/v2.1/servers/15d68c64-0569-4afa-a718-bc0e0c2cba3e => generated 1552 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:33:08.237029 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-85654cbe-c471-4bfe-884f-ea4b1ae891b5 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] 10.222.0.23 "GET /compute/v2.1/servers/4d413d7e-76c6-4b49-a7f0-ca29701c8817" status: 200 len: 1314 microversion: 2.1 time: 0.243557 Sep 09 16:33:08.238819 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 102/202] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:33:07 2022] GET /compute/v2.1/servers/4d413d7e-76c6-4b49-a7f0-ca29701c8817 => generated 1314 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:33:08.326194 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-a188102c-3030-4c1d-a955-031820307660 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:33:08.327063 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-a188102c-3030-4c1d-a955-031820307660 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: e8d23cb3-2f39-4b00-ae9d-006e392a5940] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:33:08.333106 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-a188102c-3030-4c1d-a955-031820307660 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:08.333775 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-a188102c-3030-4c1d-a955-031820307660 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:08.334297 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-a188102c-3030-4c1d-a955-031820307660 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:08.335099 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-a188102c-3030-4c1d-a955-031820307660 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:08.335657 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-a188102c-3030-4c1d-a955-031820307660 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:08.336167 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-a188102c-3030-4c1d-a955-031820307660 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:08.486160 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-a188102c-3030-4c1d-a955-031820307660 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d86f09c6304121be2021cb5c15e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ab544d0b547919794e3efb49ba0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:33:08.494420 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-a188102c-3030-4c1d-a955-031820307660 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940" status: 200 len: 1522 microversion: 2.1 time: 0.174980 Sep 09 16:33:08.495523 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 101/203] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:33:08 2022] GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940 => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:33:09.258091 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-5d12aa7c-3007-4da6-87eb-890c9a7d9f0c tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:33:09.259366 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-5d12aa7c-3007-4da6-87eb-890c9a7d9f0c tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] [instance: 15d68c64-0569-4afa-a718-bc0e0c2cba3e] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:33:09.260213 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-05e83800-6fe9-4380-a569-7600bd38f744 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:33:09.260837 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-05e83800-6fe9-4380-a569-7600bd38f744 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] [instance: 4d413d7e-76c6-4b49-a7f0-ca29701c8817] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:33:09.265741 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5d12aa7c-3007-4da6-87eb-890c9a7d9f0c tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:09.266224 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5d12aa7c-3007-4da6-87eb-890c9a7d9f0c tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:09.266677 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5d12aa7c-3007-4da6-87eb-890c9a7d9f0c tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:09.267370 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5d12aa7c-3007-4da6-87eb-890c9a7d9f0c tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:09.267817 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5d12aa7c-3007-4da6-87eb-890c9a7d9f0c tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:09.268108 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-05e83800-6fe9-4380-a569-7600bd38f744 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:09.268214 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5d12aa7c-3007-4da6-87eb-890c9a7d9f0c tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:09.268583 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-05e83800-6fe9-4380-a569-7600bd38f744 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:09.269002 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-05e83800-6fe9-4380-a569-7600bd38f744 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:09.269810 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-05e83800-6fe9-4380-a569-7600bd38f744 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:09.270305 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-05e83800-6fe9-4380-a569-7600bd38f744 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:09.271151 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-05e83800-6fe9-4380-a569-7600bd38f744 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:09.467479 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-05e83800-6fe9-4380-a569-7600bd38f744 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2fbc3668cf4a82b8eea0b67b87ca80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9243cdc25d5444d847db4f59c05fa6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:33:09.476062 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-5d12aa7c-3007-4da6-87eb-890c9a7d9f0c tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce1cd9c19584549b794df8e487abf00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f227ee89ce84dec84410a1db9b479fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:33:09.476261 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-05e83800-6fe9-4380-a569-7600bd38f744 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] 10.222.0.23 "GET /compute/v2.1/servers/4d413d7e-76c6-4b49-a7f0-ca29701c8817" status: 200 len: 1314 microversion: 2.1 time: 0.220002 Sep 09 16:33:09.476857 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 102/204] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:33:09 2022] GET /compute/v2.1/servers/4d413d7e-76c6-4b49-a7f0-ca29701c8817 => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:33:09.493812 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-5d12aa7c-3007-4da6-87eb-890c9a7d9f0c tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] 10.222.0.23 "GET /compute/v2.1/servers/15d68c64-0569-4afa-a718-bc0e0c2cba3e" status: 200 len: 1552 microversion: 2.1 time: 0.239730 Sep 09 16:33:09.494390 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 103/205] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:33:09 2022] GET /compute/v2.1/servers/15d68c64-0569-4afa-a718-bc0e0c2cba3e => generated 1552 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:33:09.519721 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-3747fbb4-c3ef-458f-93c2-1e4bcde1d2d8 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:33:09.520366 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-3747fbb4-c3ef-458f-93c2-1e4bcde1d2d8 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: e8d23cb3-2f39-4b00-ae9d-006e392a5940] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:33:09.526530 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-3747fbb4-c3ef-458f-93c2-1e4bcde1d2d8 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:09.527050 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-3747fbb4-c3ef-458f-93c2-1e4bcde1d2d8 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:09.527479 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-3747fbb4-c3ef-458f-93c2-1e4bcde1d2d8 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:09.528139 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-3747fbb4-c3ef-458f-93c2-1e4bcde1d2d8 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:09.528675 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-3747fbb4-c3ef-458f-93c2-1e4bcde1d2d8 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:09.529113 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-3747fbb4-c3ef-458f-93c2-1e4bcde1d2d8 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:09.682137 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-3747fbb4-c3ef-458f-93c2-1e4bcde1d2d8 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d86f09c6304121be2021cb5c15e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ab544d0b547919794e3efb49ba0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:33:09.690096 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-3747fbb4-c3ef-458f-93c2-1e4bcde1d2d8 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940" status: 200 len: 1522 microversion: 2.1 time: 0.174288 Sep 09 16:33:09.690692 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 103/206] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:33:09 2022] GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940 => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:33:10.498354 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-6b550e07-c30a-4677-9781-dfef8e42cd99 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:33:10.498992 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-6b550e07-c30a-4677-9781-dfef8e42cd99 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] [instance: 4d413d7e-76c6-4b49-a7f0-ca29701c8817] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:33:10.505680 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6b550e07-c30a-4677-9781-dfef8e42cd99 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:10.506160 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6b550e07-c30a-4677-9781-dfef8e42cd99 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:10.506610 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6b550e07-c30a-4677-9781-dfef8e42cd99 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:10.507290 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6b550e07-c30a-4677-9781-dfef8e42cd99 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:10.507801 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6b550e07-c30a-4677-9781-dfef8e42cd99 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:10.508164 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6b550e07-c30a-4677-9781-dfef8e42cd99 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:10.517273 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-ac730059-176e-47bc-97d2-7dc674dd558f tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:33:10.518032 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-ac730059-176e-47bc-97d2-7dc674dd558f tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] [instance: 15d68c64-0569-4afa-a718-bc0e0c2cba3e] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:33:10.524208 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-ac730059-176e-47bc-97d2-7dc674dd558f tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:10.524716 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-ac730059-176e-47bc-97d2-7dc674dd558f tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:10.525141 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-ac730059-176e-47bc-97d2-7dc674dd558f tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:10.525842 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-ac730059-176e-47bc-97d2-7dc674dd558f tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:10.526482 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-ac730059-176e-47bc-97d2-7dc674dd558f tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:10.526933 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-ac730059-176e-47bc-97d2-7dc674dd558f tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:10.706183 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-6b550e07-c30a-4677-9781-dfef8e42cd99 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2fbc3668cf4a82b8eea0b67b87ca80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9243cdc25d5444d847db4f59c05fa6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:33:10.710063 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-ac730059-176e-47bc-97d2-7dc674dd558f tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce1cd9c19584549b794df8e487abf00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f227ee89ce84dec84410a1db9b479fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:33:10.721463 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-6b550e07-c30a-4677-9781-dfef8e42cd99 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] 10.222.0.23 "GET /compute/v2.1/servers/4d413d7e-76c6-4b49-a7f0-ca29701c8817" status: 200 len: 1314 microversion: 2.1 time: 0.226847 Sep 09 16:33:10.726690 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 104/207] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:33:10 2022] GET /compute/v2.1/servers/4d413d7e-76c6-4b49-a7f0-ca29701c8817 => generated 1314 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:33:10.726848 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-ac730059-176e-47bc-97d2-7dc674dd558f tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] 10.222.0.23 "GET /compute/v2.1/servers/15d68c64-0569-4afa-a718-bc0e0c2cba3e" status: 200 len: 1552 microversion: 2.1 time: 0.211555 Sep 09 16:33:10.726848 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 104/208] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:33:10 2022] GET /compute/v2.1/servers/15d68c64-0569-4afa-a718-bc0e0c2cba3e => generated 1552 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 16:33:10.744848 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-03cf6ea1-8d4c-473a-bd5b-8d1eec9fa859 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:33:10.745459 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-03cf6ea1-8d4c-473a-bd5b-8d1eec9fa859 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: e8d23cb3-2f39-4b00-ae9d-006e392a5940] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:33:10.751735 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-03cf6ea1-8d4c-473a-bd5b-8d1eec9fa859 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:10.752219 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-03cf6ea1-8d4c-473a-bd5b-8d1eec9fa859 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:10.752648 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-03cf6ea1-8d4c-473a-bd5b-8d1eec9fa859 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:10.753339 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-03cf6ea1-8d4c-473a-bd5b-8d1eec9fa859 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:10.753790 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-03cf6ea1-8d4c-473a-bd5b-8d1eec9fa859 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:10.754220 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-03cf6ea1-8d4c-473a-bd5b-8d1eec9fa859 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:10.890386 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-03cf6ea1-8d4c-473a-bd5b-8d1eec9fa859 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d86f09c6304121be2021cb5c15e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ab544d0b547919794e3efb49ba0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:33:10.902361 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-03cf6ea1-8d4c-473a-bd5b-8d1eec9fa859 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940" status: 200 len: 1522 microversion: 2.1 time: 0.178656 Sep 09 16:33:10.903096 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 105/209] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:33:10 2022] GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940 => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:33:11.749082 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-9db6957e-9887-4082-a52a-c753c9ace3d5 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:33:11.750165 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-9db6957e-9887-4082-a52a-c753c9ace3d5 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] [instance: 4d413d7e-76c6-4b49-a7f0-ca29701c8817] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:33:11.752470 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-8c61c036-1db4-41a3-afb3-58b99c2b4a4b tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:33:11.753614 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-8c61c036-1db4-41a3-afb3-58b99c2b4a4b tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] [instance: 15d68c64-0569-4afa-a718-bc0e0c2cba3e] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:33:11.758407 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-9db6957e-9887-4082-a52a-c753c9ace3d5 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:11.758918 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-9db6957e-9887-4082-a52a-c753c9ace3d5 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:11.759365 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-9db6957e-9887-4082-a52a-c753c9ace3d5 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:11.760038 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-9db6957e-9887-4082-a52a-c753c9ace3d5 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:11.760487 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-9db6957e-9887-4082-a52a-c753c9ace3d5 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:11.760917 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-9db6957e-9887-4082-a52a-c753c9ace3d5 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:11.761063 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8c61c036-1db4-41a3-afb3-58b99c2b4a4b tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:11.761539 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8c61c036-1db4-41a3-afb3-58b99c2b4a4b tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:11.761960 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8c61c036-1db4-41a3-afb3-58b99c2b4a4b tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:11.762670 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8c61c036-1db4-41a3-afb3-58b99c2b4a4b tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:11.763107 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8c61c036-1db4-41a3-afb3-58b99c2b4a4b tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:11.763549 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8c61c036-1db4-41a3-afb3-58b99c2b4a4b tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:12.169542 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-9db6957e-9887-4082-a52a-c753c9ace3d5 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2fbc3668cf4a82b8eea0b67b87ca80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9243cdc25d5444d847db4f59c05fa6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:33:12.173222 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-8c61c036-1db4-41a3-afb3-58b99c2b4a4b tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce1cd9c19584549b794df8e487abf00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f227ee89ce84dec84410a1db9b479fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:33:12.179236 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-9db6957e-9887-4082-a52a-c753c9ace3d5 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] 10.222.0.23 "GET /compute/v2.1/servers/4d413d7e-76c6-4b49-a7f0-ca29701c8817" status: 200 len: 1499 microversion: 2.1 time: 0.436942 Sep 09 16:33:12.179836 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 105/210] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:33:11 2022] GET /compute/v2.1/servers/4d413d7e-76c6-4b49-a7f0-ca29701c8817 => generated 1499 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:33:12.182068 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-8c61c036-1db4-41a3-afb3-58b99c2b4a4b tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] 10.222.0.23 "GET /compute/v2.1/servers/15d68c64-0569-4afa-a718-bc0e0c2cba3e" status: 200 len: 1552 microversion: 2.1 time: 0.435963 Sep 09 16:33:12.182825 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 106/211] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:33:11 2022] GET /compute/v2.1/servers/15d68c64-0569-4afa-a718-bc0e0c2cba3e => generated 1552 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:33:12.187606 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-78f2a045-f285-4935-9691-b788970e2a3a tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:33:12.188381 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-78f2a045-f285-4935-9691-b788970e2a3a tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: e8d23cb3-2f39-4b00-ae9d-006e392a5940] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:33:12.194785 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-78f2a045-f285-4935-9691-b788970e2a3a tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:12.195358 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-78f2a045-f285-4935-9691-b788970e2a3a tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:12.195859 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-78f2a045-f285-4935-9691-b788970e2a3a tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:12.196607 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-78f2a045-f285-4935-9691-b788970e2a3a tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:12.197166 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-78f2a045-f285-4935-9691-b788970e2a3a tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:12.197828 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-78f2a045-f285-4935-9691-b788970e2a3a tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:12.346874 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-78f2a045-f285-4935-9691-b788970e2a3a tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d86f09c6304121be2021cb5c15e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ab544d0b547919794e3efb49ba0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:33:12.354619 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-78f2a045-f285-4935-9691-b788970e2a3a tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940" status: 200 len: 1522 microversion: 2.1 time: 0.173835 Sep 09 16:33:12.355358 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 106/212] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:33:12 2022] GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:33:12.757479 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-8a9aa500-64fc-4109-8cd4-51f8d550b1bf tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:33:12.758776 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-8a9aa500-64fc-4109-8cd4-51f8d550b1bf tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] [instance: 4d413d7e-76c6-4b49-a7f0-ca29701c8817] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:33:12.770772 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8a9aa500-64fc-4109-8cd4-51f8d550b1bf tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:12.770772 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8a9aa500-64fc-4109-8cd4-51f8d550b1bf tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:12.770772 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8a9aa500-64fc-4109-8cd4-51f8d550b1bf tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:12.771516 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8a9aa500-64fc-4109-8cd4-51f8d550b1bf tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:12.772147 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8a9aa500-64fc-4109-8cd4-51f8d550b1bf tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:12.772791 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8a9aa500-64fc-4109-8cd4-51f8d550b1bf tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:12.802307 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-8a9aa500-64fc-4109-8cd4-51f8d550b1bf tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] [instance: 4d413d7e-76c6-4b49-a7f0-ca29701c8817] Going to try to terminate instance {{(pid=127198) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 16:33:12.893765 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-8a9aa500-64fc-4109-8cd4-51f8d550b1bf tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] 10.222.0.23 "DELETE /compute/v2.1/servers/4d413d7e-76c6-4b49-a7f0-ca29701c8817" status: 204 len: 0 microversion: 2.1 time: 0.142110 Sep 09 16:33:12.894743 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 107/213] 10.222.0.23 () {58 vars in 1239 bytes} [Fri Sep 9 16:33:12 2022] DELETE /compute/v2.1/servers/4d413d7e-76c6-4b49-a7f0-ca29701c8817 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 16:33:12.903417 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-3bc6a296-d499-4e84-a5cb-dbf7f9ec4e4d tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:33:12.904019 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-3bc6a296-d499-4e84-a5cb-dbf7f9ec4e4d tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] [instance: 4d413d7e-76c6-4b49-a7f0-ca29701c8817] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:33:12.909987 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-3bc6a296-d499-4e84-a5cb-dbf7f9ec4e4d tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:12.910460 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-3bc6a296-d499-4e84-a5cb-dbf7f9ec4e4d tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:12.910919 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-3bc6a296-d499-4e84-a5cb-dbf7f9ec4e4d tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:12.911637 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-3bc6a296-d499-4e84-a5cb-dbf7f9ec4e4d tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:12.912091 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-3bc6a296-d499-4e84-a5cb-dbf7f9ec4e4d tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:12.912506 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-3bc6a296-d499-4e84-a5cb-dbf7f9ec4e4d tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:13.060010 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-3bc6a296-d499-4e84-a5cb-dbf7f9ec4e4d tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2fbc3668cf4a82b8eea0b67b87ca80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9243cdc25d5444d847db4f59c05fa6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:33:13.068739 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-3bc6a296-d499-4e84-a5cb-dbf7f9ec4e4d tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] 10.222.0.23 "GET /compute/v2.1/servers/4d413d7e-76c6-4b49-a7f0-ca29701c8817" status: 200 len: 1505 microversion: 2.1 time: 0.169083 Sep 09 16:33:13.069938 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 107/214] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:33:12 2022] GET /compute/v2.1/servers/4d413d7e-76c6-4b49-a7f0-ca29701c8817 => generated 1505 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:33:13.205167 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-4fd0fd81-3051-4e79-bb15-26f2e7847369 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:33:13.205883 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-4fd0fd81-3051-4e79-bb15-26f2e7847369 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] [instance: 15d68c64-0569-4afa-a718-bc0e0c2cba3e] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:33:13.212294 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4fd0fd81-3051-4e79-bb15-26f2e7847369 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:13.212785 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4fd0fd81-3051-4e79-bb15-26f2e7847369 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:13.213261 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4fd0fd81-3051-4e79-bb15-26f2e7847369 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:13.213954 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4fd0fd81-3051-4e79-bb15-26f2e7847369 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:13.214394 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4fd0fd81-3051-4e79-bb15-26f2e7847369 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:13.214825 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4fd0fd81-3051-4e79-bb15-26f2e7847369 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:13.359594 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-4fd0fd81-3051-4e79-bb15-26f2e7847369 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce1cd9c19584549b794df8e487abf00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f227ee89ce84dec84410a1db9b479fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:33:13.369757 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-4fd0fd81-3051-4e79-bb15-26f2e7847369 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] 10.222.0.23 "GET /compute/v2.1/servers/15d68c64-0569-4afa-a718-bc0e0c2cba3e" status: 200 len: 1552 microversion: 2.1 time: 0.168794 Sep 09 16:33:13.370962 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 108/215] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:33:13 2022] GET /compute/v2.1/servers/15d68c64-0569-4afa-a718-bc0e0c2cba3e => generated 1552 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:33:13.386898 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-c20ad874-296f-47a2-8b43-8a2eb7155caf tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:33:13.387746 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-c20ad874-296f-47a2-8b43-8a2eb7155caf tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: e8d23cb3-2f39-4b00-ae9d-006e392a5940] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:33:13.394700 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-c20ad874-296f-47a2-8b43-8a2eb7155caf tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:13.395186 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-c20ad874-296f-47a2-8b43-8a2eb7155caf tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:13.395618 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-c20ad874-296f-47a2-8b43-8a2eb7155caf tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:13.396358 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-c20ad874-296f-47a2-8b43-8a2eb7155caf tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:13.396815 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-c20ad874-296f-47a2-8b43-8a2eb7155caf tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:13.397271 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-c20ad874-296f-47a2-8b43-8a2eb7155caf tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:13.567042 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-c20ad874-296f-47a2-8b43-8a2eb7155caf tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d86f09c6304121be2021cb5c15e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ab544d0b547919794e3efb49ba0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:33:13.575750 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-c20ad874-296f-47a2-8b43-8a2eb7155caf tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940" status: 200 len: 1522 microversion: 2.1 time: 0.201417 Sep 09 16:33:13.576950 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 108/216] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:33:13 2022] GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940 => generated 1522 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:33:13.600667 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [req-5cb72270-c76b-4d23-9276-12a678aa22b9 req-071f597b-e003-48e1-9af2-aed9f882cba4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15d68c64-0569-4afa-a718-bc0e0c2cba3e", "name": "network-vif-deleted", "tag": "7a3fbdb4-6907-451e-a2ff-a2463ac94347"}]} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:33:13.610516 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-5cb72270-c76b-4d23-9276-12a678aa22b9 req-071f597b-e003-48e1-9af2-aed9f882cba4 service nova] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:13.610991 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-5cb72270-c76b-4d23-9276-12a678aa22b9 req-071f597b-e003-48e1-9af2-aed9f882cba4 service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:13.611408 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-5cb72270-c76b-4d23-9276-12a678aa22b9 req-071f597b-e003-48e1-9af2-aed9f882cba4 service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:13.622933 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.compute.server_external_events [req-5cb72270-c76b-4d23-9276-12a678aa22b9 req-071f597b-e003-48e1-9af2-aed9f882cba4 service nova] Creating event network-vif-deleted:7a3fbdb4-6907-451e-a2ff-a2463ac94347 for instance 15d68c64-0569-4afa-a718-bc0e0c2cba3e on hv-cinder-83124 Sep 09 16:33:13.628354 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [req-5cb72270-c76b-4d23-9276-12a678aa22b9 req-071f597b-e003-48e1-9af2-aed9f882cba4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031430 Sep 09 16:33:13.628925 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 109/217] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Sep 9 16:33:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:33:14.093377 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-d9dc9012-d1b5-43bc-b760-de0217b21bf1 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:33:14.093984 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-d9dc9012-d1b5-43bc-b760-de0217b21bf1 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] [instance: 4d413d7e-76c6-4b49-a7f0-ca29701c8817] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:33:14.107457 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-d9dc9012-d1b5-43bc-b760-de0217b21bf1 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:14.107952 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-d9dc9012-d1b5-43bc-b760-de0217b21bf1 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:14.108388 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-d9dc9012-d1b5-43bc-b760-de0217b21bf1 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:14.109094 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-d9dc9012-d1b5-43bc-b760-de0217b21bf1 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:14.109541 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-d9dc9012-d1b5-43bc-b760-de0217b21bf1 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:14.109961 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-d9dc9012-d1b5-43bc-b760-de0217b21bf1 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:14.287098 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-d9dc9012-d1b5-43bc-b760-de0217b21bf1 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2fbc3668cf4a82b8eea0b67b87ca80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9243cdc25d5444d847db4f59c05fa6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:33:14.296977 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-d9dc9012-d1b5-43bc-b760-de0217b21bf1 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] 10.222.0.23 "GET /compute/v2.1/servers/4d413d7e-76c6-4b49-a7f0-ca29701c8817" status: 200 len: 1505 microversion: 2.1 time: 0.207468 Sep 09 16:33:14.297918 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 109/218] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:33:14 2022] GET /compute/v2.1/servers/4d413d7e-76c6-4b49-a7f0-ca29701c8817 => generated 1505 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:33:14.396842 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-e8df1db3-0480-4d56-8d6f-b3919e399b4c tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:33:14.397577 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-e8df1db3-0480-4d56-8d6f-b3919e399b4c tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] [instance: 15d68c64-0569-4afa-a718-bc0e0c2cba3e] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:33:14.404266 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e8df1db3-0480-4d56-8d6f-b3919e399b4c tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:14.404708 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e8df1db3-0480-4d56-8d6f-b3919e399b4c tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:14.405439 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e8df1db3-0480-4d56-8d6f-b3919e399b4c tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:14.405802 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e8df1db3-0480-4d56-8d6f-b3919e399b4c tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:14.406251 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e8df1db3-0480-4d56-8d6f-b3919e399b4c tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:14.406705 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e8df1db3-0480-4d56-8d6f-b3919e399b4c tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:14.480069 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-e8df1db3-0480-4d56-8d6f-b3919e399b4c tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce1cd9c19584549b794df8e487abf00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f227ee89ce84dec84410a1db9b479fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:33:14.488812 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-e8df1db3-0480-4d56-8d6f-b3919e399b4c tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] 10.222.0.23 "GET /compute/v2.1/servers/15d68c64-0569-4afa-a718-bc0e0c2cba3e" status: 200 len: 1510 microversion: 2.1 time: 0.096180 Sep 09 16:33:14.489694 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 110/219] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:33:14 2022] GET /compute/v2.1/servers/15d68c64-0569-4afa-a718-bc0e0c2cba3e => generated 1510 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:33:14.600065 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-db94d3da-e81a-41f3-911a-e3f952968790 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:33:14.602106 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-db94d3da-e81a-41f3-911a-e3f952968790 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: e8d23cb3-2f39-4b00-ae9d-006e392a5940] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:33:14.608200 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-db94d3da-e81a-41f3-911a-e3f952968790 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:14.608823 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-db94d3da-e81a-41f3-911a-e3f952968790 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:14.609500 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-db94d3da-e81a-41f3-911a-e3f952968790 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:14.610270 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-db94d3da-e81a-41f3-911a-e3f952968790 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:14.610936 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-db94d3da-e81a-41f3-911a-e3f952968790 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:14.611425 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-db94d3da-e81a-41f3-911a-e3f952968790 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:14.771398 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-db94d3da-e81a-41f3-911a-e3f952968790 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d86f09c6304121be2021cb5c15e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ab544d0b547919794e3efb49ba0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:33:14.793900 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-db94d3da-e81a-41f3-911a-e3f952968790 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940" status: 200 len: 1522 microversion: 2.1 time: 0.197736 Sep 09 16:33:14.802271 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 110/220] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:33:14 2022] GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940 => generated 1522 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:33:15.321373 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-9c2326fb-2553-406c-bd59-66d0f469a1a4 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:33:15.322225 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-9c2326fb-2553-406c-bd59-66d0f469a1a4 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] [instance: 4d413d7e-76c6-4b49-a7f0-ca29701c8817] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:33:15.337772 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9c2326fb-2553-406c-bd59-66d0f469a1a4 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:15.338260 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9c2326fb-2553-406c-bd59-66d0f469a1a4 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:15.338722 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9c2326fb-2553-406c-bd59-66d0f469a1a4 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:15.339873 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9c2326fb-2553-406c-bd59-66d0f469a1a4 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:15.339873 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9c2326fb-2553-406c-bd59-66d0f469a1a4 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:15.340273 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9c2326fb-2553-406c-bd59-66d0f469a1a4 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:15.431924 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-9c2326fb-2553-406c-bd59-66d0f469a1a4 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2fbc3668cf4a82b8eea0b67b87ca80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9243cdc25d5444d847db4f59c05fa6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:33:15.449675 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-9c2326fb-2553-406c-bd59-66d0f469a1a4 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] 10.222.0.23 "GET /compute/v2.1/servers/4d413d7e-76c6-4b49-a7f0-ca29701c8817" status: 200 len: 1463 microversion: 2.1 time: 0.132115 Sep 09 16:33:15.450695 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 111/221] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:33:15 2022] GET /compute/v2.1/servers/4d413d7e-76c6-4b49-a7f0-ca29701c8817 => generated 1463 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:33:15.515844 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-9c0807bf-52d8-4a93-8eb0-c44a4e13082b tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:33:15.517796 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-9c0807bf-52d8-4a93-8eb0-c44a4e13082b tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] [instance: 15d68c64-0569-4afa-a718-bc0e0c2cba3e] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:33:15.536470 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-9c0807bf-52d8-4a93-8eb0-c44a4e13082b tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:15.537187 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-9c0807bf-52d8-4a93-8eb0-c44a4e13082b tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:15.537713 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-9c0807bf-52d8-4a93-8eb0-c44a4e13082b tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:15.538443 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-9c0807bf-52d8-4a93-8eb0-c44a4e13082b tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:15.538921 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-9c0807bf-52d8-4a93-8eb0-c44a4e13082b tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:15.539861 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-9c0807bf-52d8-4a93-8eb0-c44a4e13082b tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:15.579391 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-9c0807bf-52d8-4a93-8eb0-c44a4e13082b tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:15.580930 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-9c0807bf-52d8-4a93-8eb0-c44a4e13082b tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:15.581520 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-9c0807bf-52d8-4a93-8eb0-c44a4e13082b tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:15.582133 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.objects.instance [None req-9c0807bf-52d8-4a93-8eb0-c44a4e13082b tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lazy-loading 'fault' on Instance uuid 15d68c64-0569-4afa-a718-bc0e0c2cba3e {{(pid=127196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 16:33:15.644813 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [req-0cdd172b-568c-4303-9800-85bc02cd9b9f req-4a8a87b8-2a11-46c6-aab4-f0b5b33a8553 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d413d7e-76c6-4b49-a7f0-ca29701c8817", "name": "network-vif-deleted", "tag": "4a5d83c8-b468-433b-8288-e90339b62fc3"}]} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:33:15.663372 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-9c0807bf-52d8-4a93-8eb0-c44a4e13082b tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce1cd9c19584549b794df8e487abf00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f227ee89ce84dec84410a1db9b479fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:33:15.669432 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-0cdd172b-568c-4303-9800-85bc02cd9b9f req-4a8a87b8-2a11-46c6-aab4-f0b5b33a8553 service nova] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:15.670296 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-0cdd172b-568c-4303-9800-85bc02cd9b9f req-4a8a87b8-2a11-46c6-aab4-f0b5b33a8553 service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:15.671418 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-0cdd172b-568c-4303-9800-85bc02cd9b9f req-4a8a87b8-2a11-46c6-aab4-f0b5b33a8553 service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:15.675724 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-9c0807bf-52d8-4a93-8eb0-c44a4e13082b tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] 10.222.0.23 "GET /compute/v2.1/servers/15d68c64-0569-4afa-a718-bc0e0c2cba3e" status: 200 len: 1349 microversion: 2.1 time: 0.165592 Sep 09 16:33:15.683546 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 111/222] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:33:15 2022] GET /compute/v2.1/servers/15d68c64-0569-4afa-a718-bc0e0c2cba3e => generated 1349 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:33:15.687266 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.compute.server_external_events [req-0cdd172b-568c-4303-9800-85bc02cd9b9f req-4a8a87b8-2a11-46c6-aab4-f0b5b33a8553 service nova] Creating event network-vif-deleted:4a5d83c8-b468-433b-8288-e90339b62fc3 for instance 4d413d7e-76c6-4b49-a7f0-ca29701c8817 on hv-cinder-83124 Sep 09 16:33:15.695432 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [req-0cdd172b-568c-4303-9800-85bc02cd9b9f req-4a8a87b8-2a11-46c6-aab4-f0b5b33a8553 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055060 Sep 09 16:33:15.696625 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 112/223] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Sep 9 16:33:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 16:33:15.823741 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-2d05f42c-d7de-4cc5-bfb7-bf2eb15e4fb3 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:33:15.824357 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-2d05f42c-d7de-4cc5-bfb7-bf2eb15e4fb3 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: e8d23cb3-2f39-4b00-ae9d-006e392a5940] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:33:15.832224 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-2d05f42c-d7de-4cc5-bfb7-bf2eb15e4fb3 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:15.832724 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-2d05f42c-d7de-4cc5-bfb7-bf2eb15e4fb3 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:15.833167 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-2d05f42c-d7de-4cc5-bfb7-bf2eb15e4fb3 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:15.833955 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-2d05f42c-d7de-4cc5-bfb7-bf2eb15e4fb3 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:15.834539 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-2d05f42c-d7de-4cc5-bfb7-bf2eb15e4fb3 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:15.835074 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-2d05f42c-d7de-4cc5-bfb7-bf2eb15e4fb3 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:16.011405 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-2d05f42c-d7de-4cc5-bfb7-bf2eb15e4fb3 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d86f09c6304121be2021cb5c15e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ab544d0b547919794e3efb49ba0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:33:16.019830 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-2d05f42c-d7de-4cc5-bfb7-bf2eb15e4fb3 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940" status: 200 len: 1522 microversion: 2.1 time: 0.200292 Sep 09 16:33:16.020404 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 112/224] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:33:15 2022] GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940 => generated 1522 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:33:16.475355 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-eafb7ad4-d06d-4cae-a3a5-214e88a4a480 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:33:16.476338 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-eafb7ad4-d06d-4cae-a3a5-214e88a4a480 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] [instance: 4d413d7e-76c6-4b49-a7f0-ca29701c8817] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:33:16.483529 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-eafb7ad4-d06d-4cae-a3a5-214e88a4a480 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:16.483917 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-eafb7ad4-d06d-4cae-a3a5-214e88a4a480 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:16.484595 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-eafb7ad4-d06d-4cae-a3a5-214e88a4a480 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:16.485387 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-eafb7ad4-d06d-4cae-a3a5-214e88a4a480 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:16.485936 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-eafb7ad4-d06d-4cae-a3a5-214e88a4a480 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:16.486453 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-eafb7ad4-d06d-4cae-a3a5-214e88a4a480 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:16.501276 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.wsgi [None req-eafb7ad4-d06d-4cae-a3a5-214e88a4a480 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] HTTP exception thrown: Instance 4d413d7e-76c6-4b49-a7f0-ca29701c8817 could not be found. Sep 09 16:33:16.506339 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-eafb7ad4-d06d-4cae-a3a5-214e88a4a480 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Request method failure captured: Sep 09 16:33:16.506339 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: request: GET /compute/v2.1/servers/4d413d7e-76c6-4b49-a7f0-ca29701c8817 HTTP/1.1 Sep 09 16:33:16.506339 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Accept: application/json Sep 09 16:33:16.506339 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Accept-Encoding: identity Sep 09 16:33:16.506339 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Connection: close Sep 09 16:33:16.506339 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Content-Length: 0 Sep 09 16:33:16.506339 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Content-Type: application/json Sep 09 16:33:16.506339 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Host: 10.222.0.23 Sep 09 16:33:16.506339 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Openstack-System-Scope: None Sep 09 16:33:16.506339 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: User-Agent: python-urllib3/1.26.12 Sep 09 16:33:16.506339 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Auth-Token: gAAAAABjG2quCI1CB7FZV25aWt7ARzWFfv3ewE7rqNAmU85Cn5FC_h6qJndbbEJ-jeRCkn-X516xQ3MQD_hHlluiQGu90eWibbTx9j5V3Wpakx2AjGOIXwa1DIkdWMP4MtLRxAfNxHtP14QZSdiuhu96eSIp-oXw7u2n3NShF0fuTAJDuPC19j4 Sep 09 16:33:16.506339 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Domain-Id: None Sep 09 16:33:16.506339 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Domain-Name: None Sep 09 16:33:16.506339 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Identity-Status: Confirmed Sep 09 16:33:16.506339 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Is-Admin-Project: True Sep 09 16:33:16.506339 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Project-Domain-Id: default Sep 09 16:33:16.506339 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Project-Domain-Name: Default Sep 09 16:33:16.506339 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Project-Id: e9243cdc25d5444d847db4f59c05fa6a Sep 09 16:33:16.506339 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Project-Name: tempest-VolumesActionsTest-769230162 Sep 09 16:33:16.506339 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Role: member,reader Sep 09 16:33:16.506339 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Roles: member,reader Sep 09 16:33:16.507795 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e9243cdc25d5444d847db4f59c05fa6a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e9243cdc25d5444d847db4f59c05fa6a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e9243cdc25d5444d847db4f59c05fa6a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e9243cdc25d5444d847db4f59c05fa6a"}]}] Sep 09 16:33:16.507795 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Tenant: tempest-VolumesActionsTest-769230162 Sep 09 16:33:16.507795 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Tenant-Id: e9243cdc25d5444d847db4f59c05fa6a Sep 09 16:33:16.507795 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Tenant-Name: tempest-VolumesActionsTest-769230162 Sep 09 16:33:16.507795 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User: tempest-VolumesActionsTest-769230162-project Sep 09 16:33:16.507795 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User-Domain-Id: default Sep 09 16:33:16.507795 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User-Domain-Name: Default Sep 09 16:33:16.507795 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User-Id: 6d2fbc3668cf4a82b8eea0b67b87ca80 Sep 09 16:33:16.507795 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User-Name: tempest-VolumesActionsTest-769230162-project Sep 09 16:33:16.507795 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: method: > Sep 09 16:33:16.507795 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: exception: Instance 4d413d7e-76c6-4b49-a7f0-ca29701c8817 could not be found. Sep 09 16:33:16.507795 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: action_args: {'id': '4d413d7e-76c6-4b49-a7f0-ca29701c8817'} Sep 09 16:33:16.508510 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 16:33:16.508510 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:33:16.508510 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 16:33:16.508510 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 16:33:16.508510 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 16:33:16.508510 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 16:33:16.508510 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 16:33:16.508510 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 16:33:16.508510 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 16:33:16.508510 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 16:33:16.508510 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d413d7e-76c6-4b49-a7f0-ca29701c8817 could not be found. Sep 09 16:33:16.508510 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:33:16.508510 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 16:33:16.508510 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:33:16.508510 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:33:16.508510 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 16:33:16.508510 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 16:33:16.508510 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 16:33:16.508510 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 16:33:16.508510 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 16:33:16.509665 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 16:33:16.509665 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 16:33:16.509665 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 16:33:16.509665 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 16:33:16.509665 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 16:33:16.509665 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 16:33:16.509665 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 16:33:16.509665 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d413d7e-76c6-4b49-a7f0-ca29701c8817 could not be found. Sep 09 16:33:16.509665 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:33:16.509665 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 16:33:16.509665 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:33:16.509665 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:33:16.509665 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 16:33:16.509665 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 16:33:16.509665 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 16:33:16.509665 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 16:33:16.509665 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d413d7e-76c6-4b49-a7f0-ca29701c8817 could not be found. Sep 09 16:33:16.509665 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:33:16.510663 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-eafb7ad4-d06d-4cae-a3a5-214e88a4a480 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Returning 404 to user: Instance 4d413d7e-76c6-4b49-a7f0-ca29701c8817 could not be found. {{(pid=127198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 16:33:16.510663 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-eafb7ad4-d06d-4cae-a3a5-214e88a4a480 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] 10.222.0.23 "GET /compute/v2.1/servers/4d413d7e-76c6-4b49-a7f0-ca29701c8817" status: 404 len: 111 microversion: 2.1 time: 0.038556 Sep 09 16:33:16.510663 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 113/225] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:33:16 2022] GET /compute/v2.1/servers/4d413d7e-76c6-4b49-a7f0-ca29701c8817 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 16:33:16.706265 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-afee72ea-62c2-4afb-8c7a-497d4a9504ef tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:33:16.706933 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-afee72ea-62c2-4afb-8c7a-497d4a9504ef tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] [instance: 15d68c64-0569-4afa-a718-bc0e0c2cba3e] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:33:16.719359 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-afee72ea-62c2-4afb-8c7a-497d4a9504ef tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:16.719862 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-afee72ea-62c2-4afb-8c7a-497d4a9504ef tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:16.720425 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-afee72ea-62c2-4afb-8c7a-497d4a9504ef tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:16.721134 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-afee72ea-62c2-4afb-8c7a-497d4a9504ef tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:16.722029 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-afee72ea-62c2-4afb-8c7a-497d4a9504ef tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:16.722609 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-afee72ea-62c2-4afb-8c7a-497d4a9504ef tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:16.723176 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-8ead7780-522c-43a7-a8e7-01404f26042c tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-654266247", "imageRef": "0b1ba34f-2223-497a-9a18-c2ad8d398aae", "flavorRef": "452", "networks": [{"uuid": "52494a8a-ce3b-4fa0-8de6-85face071618"}]}} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:33:16.756617 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.wsgi [None req-afee72ea-62c2-4afb-8c7a-497d4a9504ef tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] HTTP exception thrown: Instance 15d68c64-0569-4afa-a718-bc0e0c2cba3e could not be found. Sep 09 16:33:16.768199 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-afee72ea-62c2-4afb-8c7a-497d4a9504ef tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Request method failure captured: Sep 09 16:33:16.768199 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: request: GET /compute/v2.1/servers/15d68c64-0569-4afa-a718-bc0e0c2cba3e HTTP/1.1 Sep 09 16:33:16.768199 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Accept: application/json Sep 09 16:33:16.768199 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Accept-Encoding: identity Sep 09 16:33:16.768199 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Connection: close Sep 09 16:33:16.768199 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Content-Length: 0 Sep 09 16:33:16.768199 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Content-Type: application/json Sep 09 16:33:16.768199 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Host: 10.222.0.23 Sep 09 16:33:16.768199 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Openstack-System-Scope: None Sep 09 16:33:16.768199 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: User-Agent: python-urllib3/1.26.12 Sep 09 16:33:16.768199 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Auth-Token: gAAAAABjG2p7Ls8vYFPf6ZDI6I_MHlQ4W1fygJ49Io4VwmTvo-cbgVZth_-j_Hjff43vPTkDcuwNyRMTYFVvDKAP1GyoT2CS3Y58YTFSVaAlxRJukQIxMxXbuiFOqQgrMGg8NBYLk8_icmuIB9daCQ1UypAPpKmxA7TrQS28WTFBhn8sf0iVs-A Sep 09 16:33:16.768199 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Domain-Id: None Sep 09 16:33:16.768199 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Domain-Name: None Sep 09 16:33:16.768199 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Identity-Status: Confirmed Sep 09 16:33:16.768199 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Is-Admin-Project: True Sep 09 16:33:16.768199 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Project-Domain-Id: default Sep 09 16:33:16.768199 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Project-Domain-Name: Default Sep 09 16:33:16.768199 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Project-Id: 1f227ee89ce84dec84410a1db9b479fc Sep 09 16:33:16.768199 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Project-Name: tempest-DeleteServersTestJSON-1717037165 Sep 09 16:33:16.768199 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Role: member,reader Sep 09 16:33:16.768199 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Roles: member,reader Sep 09 16:33:16.769533 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1f227ee89ce84dec84410a1db9b479fc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1f227ee89ce84dec84410a1db9b479fc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1f227ee89ce84dec84410a1db9b479fc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1f227ee89ce84dec84410a1db9b479fc"}]}] Sep 09 16:33:16.769533 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Tenant: tempest-DeleteServersTestJSON-1717037165 Sep 09 16:33:16.769533 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Tenant-Id: 1f227ee89ce84dec84410a1db9b479fc Sep 09 16:33:16.769533 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Tenant-Name: tempest-DeleteServersTestJSON-1717037165 Sep 09 16:33:16.769533 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-User: tempest-DeleteServersTestJSON-1717037165-project Sep 09 16:33:16.769533 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-User-Domain-Id: default Sep 09 16:33:16.769533 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-User-Domain-Name: Default Sep 09 16:33:16.769533 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-User-Id: 1ce1cd9c19584549b794df8e487abf00 Sep 09 16:33:16.769533 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-User-Name: tempest-DeleteServersTestJSON-1717037165-project Sep 09 16:33:16.769533 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: method: > Sep 09 16:33:16.769533 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: exception: Instance 15d68c64-0569-4afa-a718-bc0e0c2cba3e could not be found. Sep 09 16:33:16.769533 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: action_args: {'id': '15d68c64-0569-4afa-a718-bc0e0c2cba3e'} Sep 09 16:33:16.770288 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 16:33:16.770288 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:33:16.770288 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 16:33:16.770288 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 16:33:16.770288 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 16:33:16.770288 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 16:33:16.770288 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 16:33:16.770288 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 16:33:16.770288 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 16:33:16.770288 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 16:33:16.770288 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15d68c64-0569-4afa-a718-bc0e0c2cba3e could not be found. Sep 09 16:33:16.770288 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Sep 09 16:33:16.770288 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 16:33:16.770288 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Sep 09 16:33:16.770288 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:33:16.770288 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 16:33:16.770288 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 16:33:16.770288 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 16:33:16.770288 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 16:33:16.770288 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 16:33:16.771814 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 16:33:16.771814 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 16:33:16.771814 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 16:33:16.771814 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 16:33:16.771814 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 16:33:16.771814 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 16:33:16.771814 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 16:33:16.771814 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15d68c64-0569-4afa-a718-bc0e0c2cba3e could not be found. Sep 09 16:33:16.771814 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Sep 09 16:33:16.771814 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 16:33:16.771814 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Sep 09 16:33:16.771814 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:33:16.771814 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 16:33:16.771814 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 16:33:16.771814 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 16:33:16.771814 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 16:33:16.771814 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15d68c64-0569-4afa-a718-bc0e0c2cba3e could not be found. Sep 09 16:33:16.771814 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Sep 09 16:33:16.773659 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-afee72ea-62c2-4afb-8c7a-497d4a9504ef tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Returning 404 to user: Instance 15d68c64-0569-4afa-a718-bc0e0c2cba3e could not be found. {{(pid=127196) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 16:33:16.775184 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-afee72ea-62c2-4afb-8c7a-497d4a9504ef tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] 10.222.0.23 "GET /compute/v2.1/servers/15d68c64-0569-4afa-a718-bc0e0c2cba3e" status: 404 len: 111 microversion: 2.1 time: 0.077118 Sep 09 16:33:16.776181 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 113/226] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:33:16 2022] GET /compute/v2.1/servers/15d68c64-0569-4afa-a718-bc0e0c2cba3e => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 16:33:16.805678 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.network.neutron [None req-8ead7780-522c-43a7-a8e7-01404f26042c tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] validate_networks() for [('52494a8a-ce3b-4fa0-8de6-85face071618', None, None, None, None, None)] {{(pid=127198) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 16:33:16.948559 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-f92345e9-e362-451b-a3eb-930f25d6bdde tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:33:16.950962 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-f92345e9-e362-451b-a3eb-930f25d6bdde tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] [instance: 15d68c64-0569-4afa-a718-bc0e0c2cba3e] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:33:16.958875 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f92345e9-e362-451b-a3eb-930f25d6bdde tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:16.959356 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f92345e9-e362-451b-a3eb-930f25d6bdde tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:16.959783 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f92345e9-e362-451b-a3eb-930f25d6bdde tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:16.960473 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f92345e9-e362-451b-a3eb-930f25d6bdde tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:16.961103 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f92345e9-e362-451b-a3eb-930f25d6bdde tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:16.961675 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f92345e9-e362-451b-a3eb-930f25d6bdde tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:16.978959 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.wsgi [None req-f92345e9-e362-451b-a3eb-930f25d6bdde tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] HTTP exception thrown: Instance 15d68c64-0569-4afa-a718-bc0e0c2cba3e could not be found. Sep 09 16:33:16.980736 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-f92345e9-e362-451b-a3eb-930f25d6bdde tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Request method failure captured: Sep 09 16:33:16.980736 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: request: GET /compute/v2.1/servers/15d68c64-0569-4afa-a718-bc0e0c2cba3e/os-volume_attachments HTTP/1.1 Sep 09 16:33:16.980736 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Accept: application/json Sep 09 16:33:16.980736 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Accept-Encoding: identity Sep 09 16:33:16.980736 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Connection: close Sep 09 16:33:16.980736 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Content-Length: 0 Sep 09 16:33:16.980736 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Content-Type: application/json Sep 09 16:33:16.980736 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Host: 10.222.0.23 Sep 09 16:33:16.980736 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Openstack-System-Scope: None Sep 09 16:33:16.980736 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: User-Agent: python-urllib3/1.26.12 Sep 09 16:33:16.980736 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Auth-Token: gAAAAABjG2p7Ls8vYFPf6ZDI6I_MHlQ4W1fygJ49Io4VwmTvo-cbgVZth_-j_Hjff43vPTkDcuwNyRMTYFVvDKAP1GyoT2CS3Y58YTFSVaAlxRJukQIxMxXbuiFOqQgrMGg8NBYLk8_icmuIB9daCQ1UypAPpKmxA7TrQS28WTFBhn8sf0iVs-A Sep 09 16:33:16.980736 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Domain-Id: None Sep 09 16:33:16.980736 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Domain-Name: None Sep 09 16:33:16.980736 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Identity-Status: Confirmed Sep 09 16:33:16.980736 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Is-Admin-Project: True Sep 09 16:33:16.980736 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Project-Domain-Id: default Sep 09 16:33:16.980736 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Project-Domain-Name: Default Sep 09 16:33:16.980736 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Project-Id: 1f227ee89ce84dec84410a1db9b479fc Sep 09 16:33:16.980736 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Project-Name: tempest-DeleteServersTestJSON-1717037165 Sep 09 16:33:16.980736 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Role: member,reader Sep 09 16:33:16.980736 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Roles: member,reader Sep 09 16:33:16.982064 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1f227ee89ce84dec84410a1db9b479fc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1f227ee89ce84dec84410a1db9b479fc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1f227ee89ce84dec84410a1db9b479fc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1f227ee89ce84dec84410a1db9b479fc"}]}] Sep 09 16:33:16.982064 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Tenant: tempest-DeleteServersTestJSON-1717037165 Sep 09 16:33:16.982064 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Tenant-Id: 1f227ee89ce84dec84410a1db9b479fc Sep 09 16:33:16.982064 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Tenant-Name: tempest-DeleteServersTestJSON-1717037165 Sep 09 16:33:16.982064 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-User: tempest-DeleteServersTestJSON-1717037165-project Sep 09 16:33:16.982064 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-User-Domain-Id: default Sep 09 16:33:16.982064 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-User-Domain-Name: Default Sep 09 16:33:16.982064 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-User-Id: 1ce1cd9c19584549b794df8e487abf00 Sep 09 16:33:16.982064 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-User-Name: tempest-DeleteServersTestJSON-1717037165-project Sep 09 16:33:16.982064 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: method: > Sep 09 16:33:16.982064 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: exception: Instance 15d68c64-0569-4afa-a718-bc0e0c2cba3e could not be found. Sep 09 16:33:16.982064 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: action_args: {'server_id': '15d68c64-0569-4afa-a718-bc0e0c2cba3e'} Sep 09 16:33:16.983025 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 16:33:16.983025 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:33:16.983025 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 16:33:16.983025 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 16:33:16.983025 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 16:33:16.983025 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 16:33:16.983025 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 16:33:16.983025 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 16:33:16.983025 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 16:33:16.983025 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 16:33:16.983025 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15d68c64-0569-4afa-a718-bc0e0c2cba3e could not be found. Sep 09 16:33:16.983025 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Sep 09 16:33:16.983025 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 16:33:16.983025 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Sep 09 16:33:16.983025 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:33:16.983025 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 16:33:16.983025 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 16:33:16.983025 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 16:33:16.983025 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 16:33:16.983025 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 16:33:16.984246 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 16:33:16.984246 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 09 16:33:16.984246 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 16:33:16.984246 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 09 16:33:16.984246 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 16:33:16.984246 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 09 16:33:16.984246 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 09 16:33:16.984246 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 16:33:16.984246 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 16:33:16.984246 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15d68c64-0569-4afa-a718-bc0e0c2cba3e could not be found. Sep 09 16:33:16.984246 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Sep 09 16:33:16.984246 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 16:33:16.984246 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Sep 09 16:33:16.984246 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:33:16.984246 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 16:33:16.984246 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 16:33:16.984246 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 16:33:16.984246 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 16:33:16.984246 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15d68c64-0569-4afa-a718-bc0e0c2cba3e could not be found. Sep 09 16:33:16.984246 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Sep 09 16:33:16.986217 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-f92345e9-e362-451b-a3eb-930f25d6bdde tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Returning 404 to user: Instance 15d68c64-0569-4afa-a718-bc0e0c2cba3e could not be found. {{(pid=127196) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 16:33:16.988168 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-f92345e9-e362-451b-a3eb-930f25d6bdde tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] 10.222.0.23 "GET /compute/v2.1/servers/15d68c64-0569-4afa-a718-bc0e0c2cba3e/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.044768 Sep 09 16:33:16.988888 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 114/227] 10.222.0.23 () {58 vars in 1302 bytes} [Fri Sep 9 16:33:16 2022] GET /compute/v2.1/servers/15d68c64-0569-4afa-a718-bc0e0c2cba3e/os-volume_attachments => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 09 16:33:17.042660 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-52b0143f-15fe-44da-a111-dad0f88b253d tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:33:17.043327 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-52b0143f-15fe-44da-a111-dad0f88b253d tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: e8d23cb3-2f39-4b00-ae9d-006e392a5940] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:33:17.051981 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-52b0143f-15fe-44da-a111-dad0f88b253d tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:17.052717 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-52b0143f-15fe-44da-a111-dad0f88b253d tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:17.053149 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-52b0143f-15fe-44da-a111-dad0f88b253d tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:17.056954 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-52b0143f-15fe-44da-a111-dad0f88b253d tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:17.058862 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-52b0143f-15fe-44da-a111-dad0f88b253d tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:17.059453 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-52b0143f-15fe-44da-a111-dad0f88b253d tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:17.382335 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-52b0143f-15fe-44da-a111-dad0f88b253d tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d86f09c6304121be2021cb5c15e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ab544d0b547919794e3efb49ba0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:33:17.393143 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-52b0143f-15fe-44da-a111-dad0f88b253d tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940" status: 200 len: 1522 microversion: 2.1 time: 0.354420 Sep 09 16:33:17.412406 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 115/228] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:33:17 2022] GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940 => generated 1522 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 16:33:17.431119 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-8ead7780-522c-43a7-a8e7-01404f26042c tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Flavor limits 0:0:0 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 16:33:17.431535 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-8ead7780-522c-43a7-a8e7-01404f26042c tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Image limits 0:0:0 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 16:33:17.431999 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-8ead7780-522c-43a7-a8e7-01404f26042c tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Flavor pref 0:0:0 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 16:33:17.432449 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-8ead7780-522c-43a7-a8e7-01404f26042c tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Image pref 0:0:0 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 16:33:17.432852 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-8ead7780-522c-43a7-a8e7-01404f26042c tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 16:33:17.442631 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8ead7780-522c-43a7-a8e7-01404f26042c tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:17.443111 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8ead7780-522c-43a7-a8e7-01404f26042c tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:17.443547 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8ead7780-522c-43a7-a8e7-01404f26042c tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:17.444271 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8ead7780-522c-43a7-a8e7-01404f26042c tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:17.444718 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8ead7780-522c-43a7-a8e7-01404f26042c tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:17.445175 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8ead7780-522c-43a7-a8e7-01404f26042c tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:17.463571 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.quota [None req-8ead7780-522c-43a7-a8e7-01404f26042c tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Getting quotas for project e9243cdc25d5444d847db4f59c05fa6a. Resources: {'cores', 'instances', 'ram'} {{(pid=127198) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 16:33:17.467470 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.quota [None req-8ead7780-522c-43a7-a8e7-01404f26042c tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Getting quotas for user 6d2fbc3668cf4a82b8eea0b67b87ca80 and project e9243cdc25d5444d847db4f59c05fa6a. Resources: {'cores', 'instances', 'ram'} {{(pid=127198) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 16:33:17.479084 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-8ead7780-522c-43a7-a8e7-01404f26042c tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Going to run 1 instances... {{(pid=127198) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 16:33:17.482031 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-8ead7780-522c-43a7-a8e7-01404f26042c tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] [instance: 90c05260-2024-4606-925b-8e63442113f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0b1ba34f-2223-497a-9a18-c2ad8d398aae',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127198) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 16:33:17.531530 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-8ead7780-522c-43a7-a8e7-01404f26042c tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.813237 Sep 09 16:33:17.532169 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 114/229] 10.222.0.23 () {60 vars in 1147 bytes} [Fri Sep 9 16:33:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 815 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 16:33:17.544418 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-7d377f18-a25e-499d-a645-30216ec9617c tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:33:17.545170 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-7d377f18-a25e-499d-a645-30216ec9617c tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] [instance: 90c05260-2024-4606-925b-8e63442113f7] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:33:17.613709 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-7d377f18-a25e-499d-a645-30216ec9617c tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2fbc3668cf4a82b8eea0b67b87ca80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9243cdc25d5444d847db4f59c05fa6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:33:17.624018 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-7d377f18-a25e-499d-a645-30216ec9617c tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] 10.222.0.23 "GET /compute/v2.1/servers/90c05260-2024-4606-925b-8e63442113f7" status: 200 len: 1213 microversion: 2.1 time: 0.084016 Sep 09 16:33:17.625143 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 116/230] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:33:17 2022] GET /compute/v2.1/servers/90c05260-2024-4606-925b-8e63442113f7 => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:33:18.317614 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-adb16805-4f4d-4c78-b554-8eaa250546b3 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:33:18.318159 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-adb16805-4f4d-4c78-b554-8eaa250546b3 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] [instance: 15d68c64-0569-4afa-a718-bc0e0c2cba3e] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:33:18.331074 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-adb16805-4f4d-4c78-b554-8eaa250546b3 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:18.332071 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-adb16805-4f4d-4c78-b554-8eaa250546b3 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:18.333008 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-adb16805-4f4d-4c78-b554-8eaa250546b3 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:18.334363 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-adb16805-4f4d-4c78-b554-8eaa250546b3 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:18.334918 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-adb16805-4f4d-4c78-b554-8eaa250546b3 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:18.335391 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-adb16805-4f4d-4c78-b554-8eaa250546b3 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:18.352707 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.wsgi [None req-adb16805-4f4d-4c78-b554-8eaa250546b3 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] HTTP exception thrown: Instance 15d68c64-0569-4afa-a718-bc0e0c2cba3e could not be found. Sep 09 16:33:18.355117 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-adb16805-4f4d-4c78-b554-8eaa250546b3 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Request method failure captured: Sep 09 16:33:18.355117 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: request: DELETE /compute/v2.1/servers/15d68c64-0569-4afa-a718-bc0e0c2cba3e HTTP/1.1 Sep 09 16:33:18.355117 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Accept: application/json Sep 09 16:33:18.355117 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Accept-Encoding: identity Sep 09 16:33:18.355117 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Connection: close Sep 09 16:33:18.355117 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Content-Length: 0 Sep 09 16:33:18.355117 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Content-Type: application/json Sep 09 16:33:18.355117 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Host: 10.222.0.23 Sep 09 16:33:18.355117 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Openstack-System-Scope: None Sep 09 16:33:18.355117 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: User-Agent: python-urllib3/1.26.12 Sep 09 16:33:18.355117 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Auth-Token: gAAAAABjG2p7Ls8vYFPf6ZDI6I_MHlQ4W1fygJ49Io4VwmTvo-cbgVZth_-j_Hjff43vPTkDcuwNyRMTYFVvDKAP1GyoT2CS3Y58YTFSVaAlxRJukQIxMxXbuiFOqQgrMGg8NBYLk8_icmuIB9daCQ1UypAPpKmxA7TrQS28WTFBhn8sf0iVs-A Sep 09 16:33:18.355117 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Domain-Id: None Sep 09 16:33:18.355117 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Domain-Name: None Sep 09 16:33:18.355117 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Identity-Status: Confirmed Sep 09 16:33:18.355117 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Is-Admin-Project: True Sep 09 16:33:18.355117 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Project-Domain-Id: default Sep 09 16:33:18.355117 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Project-Domain-Name: Default Sep 09 16:33:18.355117 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Project-Id: 1f227ee89ce84dec84410a1db9b479fc Sep 09 16:33:18.355117 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Project-Name: tempest-DeleteServersTestJSON-1717037165 Sep 09 16:33:18.355117 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Role: member,reader Sep 09 16:33:18.355117 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Roles: member,reader Sep 09 16:33:18.357194 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1f227ee89ce84dec84410a1db9b479fc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1f227ee89ce84dec84410a1db9b479fc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1f227ee89ce84dec84410a1db9b479fc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1f227ee89ce84dec84410a1db9b479fc"}]}] Sep 09 16:33:18.357194 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Tenant: tempest-DeleteServersTestJSON-1717037165 Sep 09 16:33:18.357194 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Tenant-Id: 1f227ee89ce84dec84410a1db9b479fc Sep 09 16:33:18.357194 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Tenant-Name: tempest-DeleteServersTestJSON-1717037165 Sep 09 16:33:18.357194 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User: tempest-DeleteServersTestJSON-1717037165-project Sep 09 16:33:18.357194 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User-Domain-Id: default Sep 09 16:33:18.357194 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User-Domain-Name: Default Sep 09 16:33:18.357194 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User-Id: 1ce1cd9c19584549b794df8e487abf00 Sep 09 16:33:18.357194 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User-Name: tempest-DeleteServersTestJSON-1717037165-project Sep 09 16:33:18.357194 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: method: > Sep 09 16:33:18.357194 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: exception: Instance 15d68c64-0569-4afa-a718-bc0e0c2cba3e could not be found. Sep 09 16:33:18.357194 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: action_args: {'id': '15d68c64-0569-4afa-a718-bc0e0c2cba3e'} Sep 09 16:33:18.358314 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 16:33:18.358314 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:33:18.358314 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 16:33:18.358314 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 16:33:18.358314 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 16:33:18.358314 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 16:33:18.358314 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 16:33:18.358314 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 16:33:18.358314 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 16:33:18.358314 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 16:33:18.358314 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15d68c64-0569-4afa-a718-bc0e0c2cba3e could not be found. Sep 09 16:33:18.358314 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:33:18.358314 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 16:33:18.358314 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:33:18.358314 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:33:18.358314 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 16:33:18.358314 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 16:33:18.358314 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 16:33:18.358314 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 16:33:18.358314 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 16:33:18.365833 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 16:33:18.365833 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 09 16:33:18.365833 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 09 16:33:18.365833 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 09 16:33:18.365833 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 09 16:33:18.365833 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 16:33:18.365833 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 16:33:18.365833 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 16:33:18.365833 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 16:33:18.365833 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15d68c64-0569-4afa-a718-bc0e0c2cba3e could not be found. Sep 09 16:33:18.365833 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:33:18.365833 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 16:33:18.365833 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:33:18.365833 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:33:18.365833 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 16:33:18.365833 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 16:33:18.365833 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 16:33:18.365833 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 16:33:18.365833 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15d68c64-0569-4afa-a718-bc0e0c2cba3e could not be found. Sep 09 16:33:18.365833 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:33:18.368269 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-adb16805-4f4d-4c78-b554-8eaa250546b3 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Returning 404 to user: Instance 15d68c64-0569-4afa-a718-bc0e0c2cba3e could not be found. {{(pid=127198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 16:33:18.368269 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-adb16805-4f4d-4c78-b554-8eaa250546b3 tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] 10.222.0.23 "DELETE /compute/v2.1/servers/15d68c64-0569-4afa-a718-bc0e0c2cba3e" status: 404 len: 111 microversion: 2.1 time: 0.043845 Sep 09 16:33:18.368269 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 115/231] 10.222.0.23 () {58 vars in 1239 bytes} [Fri Sep 9 16:33:18 2022] DELETE /compute/v2.1/servers/15d68c64-0569-4afa-a718-bc0e0c2cba3e => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 09 16:33:18.370252 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-05ce007a-609f-4a48-b6a3-0d302f1435cc tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:33:18.370984 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-05ce007a-609f-4a48-b6a3-0d302f1435cc tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] [instance: 15d68c64-0569-4afa-a718-bc0e0c2cba3e] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:33:18.377517 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-05ce007a-609f-4a48-b6a3-0d302f1435cc tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:18.377917 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-05ce007a-609f-4a48-b6a3-0d302f1435cc tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:18.378364 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-05ce007a-609f-4a48-b6a3-0d302f1435cc tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:18.379077 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-05ce007a-609f-4a48-b6a3-0d302f1435cc tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:18.379511 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-05ce007a-609f-4a48-b6a3-0d302f1435cc tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:18.379955 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-05ce007a-609f-4a48-b6a3-0d302f1435cc tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:18.394273 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.wsgi [None req-05ce007a-609f-4a48-b6a3-0d302f1435cc tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] HTTP exception thrown: Instance 15d68c64-0569-4afa-a718-bc0e0c2cba3e could not be found. Sep 09 16:33:18.396337 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-05ce007a-609f-4a48-b6a3-0d302f1435cc tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Request method failure captured: Sep 09 16:33:18.396337 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: request: GET /compute/v2.1/servers/15d68c64-0569-4afa-a718-bc0e0c2cba3e HTTP/1.1 Sep 09 16:33:18.396337 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Accept: application/json Sep 09 16:33:18.396337 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Accept-Encoding: identity Sep 09 16:33:18.396337 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Connection: close Sep 09 16:33:18.396337 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Content-Length: 0 Sep 09 16:33:18.396337 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Content-Type: application/json Sep 09 16:33:18.396337 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Host: 10.222.0.23 Sep 09 16:33:18.396337 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Openstack-System-Scope: None Sep 09 16:33:18.396337 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: User-Agent: python-urllib3/1.26.12 Sep 09 16:33:18.396337 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Auth-Token: gAAAAABjG2p7Ls8vYFPf6ZDI6I_MHlQ4W1fygJ49Io4VwmTvo-cbgVZth_-j_Hjff43vPTkDcuwNyRMTYFVvDKAP1GyoT2CS3Y58YTFSVaAlxRJukQIxMxXbuiFOqQgrMGg8NBYLk8_icmuIB9daCQ1UypAPpKmxA7TrQS28WTFBhn8sf0iVs-A Sep 09 16:33:18.396337 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Domain-Id: None Sep 09 16:33:18.396337 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Domain-Name: None Sep 09 16:33:18.396337 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Identity-Status: Confirmed Sep 09 16:33:18.396337 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Is-Admin-Project: True Sep 09 16:33:18.396337 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Project-Domain-Id: default Sep 09 16:33:18.396337 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Project-Domain-Name: Default Sep 09 16:33:18.396337 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Project-Id: 1f227ee89ce84dec84410a1db9b479fc Sep 09 16:33:18.396337 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Project-Name: tempest-DeleteServersTestJSON-1717037165 Sep 09 16:33:18.396337 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Role: member,reader Sep 09 16:33:18.396337 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Roles: member,reader Sep 09 16:33:18.397546 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1f227ee89ce84dec84410a1db9b479fc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1f227ee89ce84dec84410a1db9b479fc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1f227ee89ce84dec84410a1db9b479fc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1f227ee89ce84dec84410a1db9b479fc"}]}] Sep 09 16:33:18.397546 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Tenant: tempest-DeleteServersTestJSON-1717037165 Sep 09 16:33:18.397546 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Tenant-Id: 1f227ee89ce84dec84410a1db9b479fc Sep 09 16:33:18.397546 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Tenant-Name: tempest-DeleteServersTestJSON-1717037165 Sep 09 16:33:18.397546 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-User: tempest-DeleteServersTestJSON-1717037165-project Sep 09 16:33:18.397546 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-User-Domain-Id: default Sep 09 16:33:18.397546 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-User-Domain-Name: Default Sep 09 16:33:18.397546 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-User-Id: 1ce1cd9c19584549b794df8e487abf00 Sep 09 16:33:18.397546 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-User-Name: tempest-DeleteServersTestJSON-1717037165-project Sep 09 16:33:18.397546 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: method: > Sep 09 16:33:18.397546 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: exception: Instance 15d68c64-0569-4afa-a718-bc0e0c2cba3e could not be found. Sep 09 16:33:18.397546 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: action_args: {'id': '15d68c64-0569-4afa-a718-bc0e0c2cba3e'} Sep 09 16:33:18.398231 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 16:33:18.398231 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:33:18.398231 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 16:33:18.398231 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 16:33:18.398231 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 16:33:18.398231 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 16:33:18.398231 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 16:33:18.398231 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 16:33:18.398231 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 16:33:18.398231 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 16:33:18.398231 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15d68c64-0569-4afa-a718-bc0e0c2cba3e could not be found. Sep 09 16:33:18.398231 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Sep 09 16:33:18.398231 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 16:33:18.398231 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Sep 09 16:33:18.398231 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:33:18.398231 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 16:33:18.398231 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 16:33:18.398231 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 16:33:18.398231 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 16:33:18.398231 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 16:33:18.399271 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 16:33:18.399271 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 16:33:18.399271 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 16:33:18.399271 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 16:33:18.399271 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 16:33:18.399271 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 16:33:18.399271 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 16:33:18.399271 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15d68c64-0569-4afa-a718-bc0e0c2cba3e could not be found. Sep 09 16:33:18.399271 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Sep 09 16:33:18.399271 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 16:33:18.399271 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Sep 09 16:33:18.399271 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:33:18.399271 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 16:33:18.399271 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 16:33:18.399271 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 16:33:18.399271 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 16:33:18.399271 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15d68c64-0569-4afa-a718-bc0e0c2cba3e could not be found. Sep 09 16:33:18.399271 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Sep 09 16:33:18.401621 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-05ce007a-609f-4a48-b6a3-0d302f1435cc tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] Returning 404 to user: Instance 15d68c64-0569-4afa-a718-bc0e0c2cba3e could not be found. {{(pid=127196) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 16:33:18.402718 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-05ce007a-609f-4a48-b6a3-0d302f1435cc tempest-DeleteServersTestJSON-1717037165 tempest-DeleteServersTestJSON-1717037165-project] 10.222.0.23 "GET /compute/v2.1/servers/15d68c64-0569-4afa-a718-bc0e0c2cba3e" status: 404 len: 111 microversion: 2.1 time: 0.038716 Sep 09 16:33:18.403476 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 117/232] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:33:18 2022] GET /compute/v2.1/servers/15d68c64-0569-4afa-a718-bc0e0c2cba3e => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 09 16:33:18.419776 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-b4a7c3b1-a8d7-4d11-894b-56b35d752db5 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:33:18.420442 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-b4a7c3b1-a8d7-4d11-894b-56b35d752db5 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: e8d23cb3-2f39-4b00-ae9d-006e392a5940] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:33:18.436345 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b4a7c3b1-a8d7-4d11-894b-56b35d752db5 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:18.436837 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b4a7c3b1-a8d7-4d11-894b-56b35d752db5 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:18.437266 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b4a7c3b1-a8d7-4d11-894b-56b35d752db5 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:18.437956 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b4a7c3b1-a8d7-4d11-894b-56b35d752db5 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:18.438399 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b4a7c3b1-a8d7-4d11-894b-56b35d752db5 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:18.439038 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-f86b0eb9-24f7-45ef-af07-cc2aeaca606c tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1345673838", "imageRef": "0b1ba34f-2223-497a-9a18-c2ad8d398aae", "flavorRef": "452"}} {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:33:18.439227 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b4a7c3b1-a8d7-4d11-894b-56b35d752db5 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:18.503567 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.network.neutron [None req-f86b0eb9-24f7-45ef-af07-cc2aeaca606c tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] validate_networks() for None {{(pid=127196) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 16:33:18.905735 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-b4a7c3b1-a8d7-4d11-894b-56b35d752db5 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d86f09c6304121be2021cb5c15e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ab544d0b547919794e3efb49ba0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:33:18.920738 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-b4a7c3b1-a8d7-4d11-894b-56b35d752db5 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940" status: 200 len: 1522 microversion: 2.1 time: 0.504701 Sep 09 16:33:18.929866 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 116/233] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:33:18 2022] GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940 => generated 1522 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:33:18.936469 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-d68cb75b-2e47-4ee3-bb97-ff6d9205cf9c tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:33:18.937470 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-d68cb75b-2e47-4ee3-bb97-ff6d9205cf9c tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] [instance: 90c05260-2024-4606-925b-8e63442113f7] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:33:18.949589 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d68cb75b-2e47-4ee3-bb97-ff6d9205cf9c tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:18.950076 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d68cb75b-2e47-4ee3-bb97-ff6d9205cf9c tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:18.951127 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d68cb75b-2e47-4ee3-bb97-ff6d9205cf9c tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:18.951883 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d68cb75b-2e47-4ee3-bb97-ff6d9205cf9c tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:18.952335 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d68cb75b-2e47-4ee3-bb97-ff6d9205cf9c tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:18.952749 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d68cb75b-2e47-4ee3-bb97-ff6d9205cf9c tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:19.061347 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.virt.hardware [None req-f86b0eb9-24f7-45ef-af07-cc2aeaca606c tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Flavor limits 0:0:0 {{(pid=127196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 16:33:19.061814 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.virt.hardware [None req-f86b0eb9-24f7-45ef-af07-cc2aeaca606c tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Image limits 0:0:0 {{(pid=127196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 16:33:19.062337 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.virt.hardware [None req-f86b0eb9-24f7-45ef-af07-cc2aeaca606c tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Flavor pref 0:0:0 {{(pid=127196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 16:33:19.063009 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.virt.hardware [None req-f86b0eb9-24f7-45ef-af07-cc2aeaca606c tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Image pref 0:0:0 {{(pid=127196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 16:33:19.064318 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.virt.hardware [None req-f86b0eb9-24f7-45ef-af07-cc2aeaca606c tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 16:33:19.080306 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f86b0eb9-24f7-45ef-af07-cc2aeaca606c tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:19.081078 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f86b0eb9-24f7-45ef-af07-cc2aeaca606c tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:19.081661 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f86b0eb9-24f7-45ef-af07-cc2aeaca606c tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:19.087553 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f86b0eb9-24f7-45ef-af07-cc2aeaca606c tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:19.088557 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f86b0eb9-24f7-45ef-af07-cc2aeaca606c tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:19.089548 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f86b0eb9-24f7-45ef-af07-cc2aeaca606c tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:19.091320 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-d68cb75b-2e47-4ee3-bb97-ff6d9205cf9c tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2fbc3668cf4a82b8eea0b67b87ca80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9243cdc25d5444d847db4f59c05fa6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:33:19.107784 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-d68cb75b-2e47-4ee3-bb97-ff6d9205cf9c tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] 10.222.0.23 "GET /compute/v2.1/servers/90c05260-2024-4606-925b-8e63442113f7" status: 200 len: 1273 microversion: 2.1 time: 0.176345 Sep 09 16:33:19.122536 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 117/234] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:33:18 2022] GET /compute/v2.1/servers/90c05260-2024-4606-925b-8e63442113f7 => generated 1273 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:33:19.122743 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.quota [None req-f86b0eb9-24f7-45ef-af07-cc2aeaca606c tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Getting quotas for project a7bd597164874d2ca0c716694156cc03. Resources: {'cores', 'instances', 'ram'} {{(pid=127196) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 16:33:19.126059 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.quota [None req-f86b0eb9-24f7-45ef-af07-cc2aeaca606c tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Getting quotas for user 0e16e344f43f4fb8bf89e5fa9cd4a338 and project a7bd597164874d2ca0c716694156cc03. Resources: {'cores', 'instances', 'ram'} {{(pid=127196) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 16:33:19.167530 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG dbcounter [-] [127196] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=127196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:33:19.171444 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-f86b0eb9-24f7-45ef-af07-cc2aeaca606c tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Going to run 1 instances... {{(pid=127196) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 16:33:19.179264 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-f86b0eb9-24f7-45ef-af07-cc2aeaca606c tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] [instance: f86519e0-2abf-4492-b504-eb4177c1cac5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0b1ba34f-2223-497a-9a18-c2ad8d398aae',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127196) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 16:33:19.313189 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-f86b0eb9-24f7-45ef-af07-cc2aeaca606c tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.878260 Sep 09 16:33:19.321313 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 118/235] 10.222.0.23 () {60 vars in 1147 bytes} [Fri Sep 9 16:33:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 887 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 16:33:19.327650 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-6513bdf0-0868-4bc4-bc7f-9985bea7ead9 tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:33:19.328748 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-6513bdf0-0868-4bc4-bc7f-9985bea7ead9 tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] [instance: f86519e0-2abf-4492-b504-eb4177c1cac5] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:33:19.457791 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-6513bdf0-0868-4bc4-bc7f-9985bea7ead9 tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e16e344f43f4fb8bf89e5fa9cd4a338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7bd597164874d2ca0c716694156cc03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:33:19.466934 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-6513bdf0-0868-4bc4-bc7f-9985bea7ead9 tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] 10.222.0.23 "GET /compute/v2.1/servers/f86519e0-2abf-4492-b504-eb4177c1cac5" status: 200 len: 1215 microversion: 2.1 time: 0.144364 Sep 09 16:33:19.467521 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 118/236] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:33:19 2022] GET /compute/v2.1/servers/f86519e0-2abf-4492-b504-eb4177c1cac5 => generated 1215 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:33:19.946519 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-d55854eb-7d5b-4675-9f70-be96cfc8cad4 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:33:19.947581 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-d55854eb-7d5b-4675-9f70-be96cfc8cad4 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: e8d23cb3-2f39-4b00-ae9d-006e392a5940] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:33:19.956147 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-d55854eb-7d5b-4675-9f70-be96cfc8cad4 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:19.962857 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-d55854eb-7d5b-4675-9f70-be96cfc8cad4 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:19.963608 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-d55854eb-7d5b-4675-9f70-be96cfc8cad4 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:19.964388 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-d55854eb-7d5b-4675-9f70-be96cfc8cad4 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:19.964911 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-d55854eb-7d5b-4675-9f70-be96cfc8cad4 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:19.965334 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-d55854eb-7d5b-4675-9f70-be96cfc8cad4 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:19.988891 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG dbcounter [-] [127196] Writing DB stats nova_cell1:SELECT=100 {{(pid=127196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:33:20.141452 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-62e4ceee-959c-4a74-b890-2093752e8fdb tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:33:20.143202 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-62e4ceee-959c-4a74-b890-2093752e8fdb tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] [instance: 90c05260-2024-4606-925b-8e63442113f7] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:33:20.147900 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:33:20.158312 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-62e4ceee-959c-4a74-b890-2093752e8fdb tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:20.159521 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-62e4ceee-959c-4a74-b890-2093752e8fdb tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:20.160526 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-62e4ceee-959c-4a74-b890-2093752e8fdb tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:20.162101 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-62e4ceee-959c-4a74-b890-2093752e8fdb tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:20.163036 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-62e4ceee-959c-4a74-b890-2093752e8fdb tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:20.163821 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-62e4ceee-959c-4a74-b890-2093752e8fdb tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:20.276348 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-d55854eb-7d5b-4675-9f70-be96cfc8cad4 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d86f09c6304121be2021cb5c15e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ab544d0b547919794e3efb49ba0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:33:20.285755 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-d55854eb-7d5b-4675-9f70-be96cfc8cad4 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940" status: 200 len: 1522 microversion: 2.1 time: 0.343431 Sep 09 16:33:20.288029 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 119/237] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:33:19 2022] GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940 => generated 1522 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:33:20.433484 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-62e4ceee-959c-4a74-b890-2093752e8fdb tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2fbc3668cf4a82b8eea0b67b87ca80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9243cdc25d5444d847db4f59c05fa6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:33:20.441758 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-62e4ceee-959c-4a74-b890-2093752e8fdb tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] 10.222.0.23 "GET /compute/v2.1/servers/90c05260-2024-4606-925b-8e63442113f7" status: 200 len: 1313 microversion: 2.1 time: 0.307304 Sep 09 16:33:20.452783 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 119/238] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:33:20 2022] GET /compute/v2.1/servers/90c05260-2024-4606-925b-8e63442113f7 => generated 1313 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:33:20.493649 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-53d3bc85-227d-443d-b7fe-457262704a3c tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:33:20.494429 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-53d3bc85-227d-443d-b7fe-457262704a3c tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] [instance: f86519e0-2abf-4492-b504-eb4177c1cac5] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:33:20.502007 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-53d3bc85-227d-443d-b7fe-457262704a3c tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:20.503174 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-53d3bc85-227d-443d-b7fe-457262704a3c tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:20.503746 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-53d3bc85-227d-443d-b7fe-457262704a3c tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:20.504746 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-53d3bc85-227d-443d-b7fe-457262704a3c tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:20.505468 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-53d3bc85-227d-443d-b7fe-457262704a3c tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:20.506016 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-53d3bc85-227d-443d-b7fe-457262704a3c tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:20.602367 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-53d3bc85-227d-443d-b7fe-457262704a3c tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e16e344f43f4fb8bf89e5fa9cd4a338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7bd597164874d2ca0c716694156cc03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:33:20.612835 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-53d3bc85-227d-443d-b7fe-457262704a3c tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] 10.222.0.23 "GET /compute/v2.1/servers/f86519e0-2abf-4492-b504-eb4177c1cac5" status: 200 len: 1267 microversion: 2.1 time: 0.123114 Sep 09 16:33:20.613837 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 120/239] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:33:20 2022] GET /compute/v2.1/servers/f86519e0-2abf-4492-b504-eb4177c1cac5 => generated 1267 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:33:20.858690 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [req-ce1e0961-be05-4df8-b4f7-144ffe75cc1e req-1e656156-1bfc-4e56-9a51-703c6aa4933c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90c05260-2024-4606-925b-8e63442113f7", "tag": "0df0e967-b65d-4297-9c81-63241dbcb10e"}]} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:33:20.868906 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-ce1e0961-be05-4df8-b4f7-144ffe75cc1e req-1e656156-1bfc-4e56-9a51-703c6aa4933c service nova] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:20.869394 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-ce1e0961-be05-4df8-b4f7-144ffe75cc1e req-1e656156-1bfc-4e56-9a51-703c6aa4933c service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:20.870226 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-ce1e0961-be05-4df8-b4f7-144ffe75cc1e req-1e656156-1bfc-4e56-9a51-703c6aa4933c service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:20.884115 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.compute.server_external_events [req-ce1e0961-be05-4df8-b4f7-144ffe75cc1e req-1e656156-1bfc-4e56-9a51-703c6aa4933c service nova] Creating event network-changed:0df0e967-b65d-4297-9c81-63241dbcb10e for instance 90c05260-2024-4606-925b-8e63442113f7 on hv-cinder-83124 Sep 09 16:33:20.890553 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [req-ce1e0961-be05-4df8-b4f7-144ffe75cc1e req-1e656156-1bfc-4e56-9a51-703c6aa4933c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035417 Sep 09 16:33:20.891384 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 120/240] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Sep 9 16:33:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:33:21.309994 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-35a56a1f-fac8-4b4b-a0d8-81e16bef57cb tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:33:21.310794 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-35a56a1f-fac8-4b4b-a0d8-81e16bef57cb tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: e8d23cb3-2f39-4b00-ae9d-006e392a5940] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:33:21.316821 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-35a56a1f-fac8-4b4b-a0d8-81e16bef57cb tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:21.317301 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-35a56a1f-fac8-4b4b-a0d8-81e16bef57cb tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:21.317724 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-35a56a1f-fac8-4b4b-a0d8-81e16bef57cb tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:21.318406 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-35a56a1f-fac8-4b4b-a0d8-81e16bef57cb tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:21.318925 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-35a56a1f-fac8-4b4b-a0d8-81e16bef57cb tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:21.319374 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-35a56a1f-fac8-4b4b-a0d8-81e16bef57cb tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:21.467700 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-5124eae6-a584-464c-ba4b-78a37f08ee32 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:33:21.468604 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-5124eae6-a584-464c-ba4b-78a37f08ee32 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] [instance: 90c05260-2024-4606-925b-8e63442113f7] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:33:21.478949 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5124eae6-a584-464c-ba4b-78a37f08ee32 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:21.479444 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5124eae6-a584-464c-ba4b-78a37f08ee32 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:21.479871 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5124eae6-a584-464c-ba4b-78a37f08ee32 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:21.480621 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5124eae6-a584-464c-ba4b-78a37f08ee32 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:21.481072 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5124eae6-a584-464c-ba4b-78a37f08ee32 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:21.481849 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5124eae6-a584-464c-ba4b-78a37f08ee32 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:21.654940 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-35a56a1f-fac8-4b4b-a0d8-81e16bef57cb tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d86f09c6304121be2021cb5c15e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ab544d0b547919794e3efb49ba0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:33:21.663779 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-35a56a1f-fac8-4b4b-a0d8-81e16bef57cb tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940" status: 200 len: 1522 microversion: 2.1 time: 0.358260 Sep 09 16:33:21.664412 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 121/241] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:33:21 2022] GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940 => generated 1522 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:33:21.678555 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-91bc455d-4a58-49cf-a57f-f32fedc4f070 tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:33:21.678555 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-91bc455d-4a58-49cf-a57f-f32fedc4f070 tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] [instance: f86519e0-2abf-4492-b504-eb4177c1cac5] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:33:21.678555 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-91bc455d-4a58-49cf-a57f-f32fedc4f070 tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:21.678555 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-91bc455d-4a58-49cf-a57f-f32fedc4f070 tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:21.679039 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-91bc455d-4a58-49cf-a57f-f32fedc4f070 tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:21.679039 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-91bc455d-4a58-49cf-a57f-f32fedc4f070 tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:21.679039 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-91bc455d-4a58-49cf-a57f-f32fedc4f070 tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:21.679039 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-91bc455d-4a58-49cf-a57f-f32fedc4f070 tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:21.781251 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-91bc455d-4a58-49cf-a57f-f32fedc4f070 tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e16e344f43f4fb8bf89e5fa9cd4a338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7bd597164874d2ca0c716694156cc03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:33:21.792539 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-91bc455d-4a58-49cf-a57f-f32fedc4f070 tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] 10.222.0.23 "GET /compute/v2.1/servers/f86519e0-2abf-4492-b504-eb4177c1cac5" status: 200 len: 1273 microversion: 2.1 time: 0.126149 Sep 09 16:33:21.810104 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 122/242] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:33:21 2022] GET /compute/v2.1/servers/f86519e0-2abf-4492-b504-eb4177c1cac5 => generated 1273 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:33:21.844280 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-5124eae6-a584-464c-ba4b-78a37f08ee32 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2fbc3668cf4a82b8eea0b67b87ca80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9243cdc25d5444d847db4f59c05fa6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:33:21.853325 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:33:21.860336 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-5124eae6-a584-464c-ba4b-78a37f08ee32 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] 10.222.0.23 "GET /compute/v2.1/servers/90c05260-2024-4606-925b-8e63442113f7" status: 200 len: 1313 microversion: 2.1 time: 0.398668 Sep 09 16:33:21.861395 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 121/243] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:33:21 2022] GET /compute/v2.1/servers/90c05260-2024-4606-925b-8e63442113f7 => generated 1313 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 16:33:22.692331 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-337bd928-d9a3-4b9d-837b-cdcba8aa4e28 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:33:22.692977 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-337bd928-d9a3-4b9d-837b-cdcba8aa4e28 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: e8d23cb3-2f39-4b00-ae9d-006e392a5940] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:33:22.700495 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-337bd928-d9a3-4b9d-837b-cdcba8aa4e28 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:22.701444 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-337bd928-d9a3-4b9d-837b-cdcba8aa4e28 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:22.702240 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-337bd928-d9a3-4b9d-837b-cdcba8aa4e28 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:22.704856 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-337bd928-d9a3-4b9d-837b-cdcba8aa4e28 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:22.707408 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-337bd928-d9a3-4b9d-837b-cdcba8aa4e28 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:22.708307 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-337bd928-d9a3-4b9d-837b-cdcba8aa4e28 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:22.820775 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-7b27578c-3dca-498b-8097-ea69fe0bb2c0 tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:33:22.824841 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-7b27578c-3dca-498b-8097-ea69fe0bb2c0 tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] [instance: f86519e0-2abf-4492-b504-eb4177c1cac5] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:33:22.835238 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7b27578c-3dca-498b-8097-ea69fe0bb2c0 tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:22.836086 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7b27578c-3dca-498b-8097-ea69fe0bb2c0 tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:22.836749 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7b27578c-3dca-498b-8097-ea69fe0bb2c0 tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:22.837650 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7b27578c-3dca-498b-8097-ea69fe0bb2c0 tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:22.838271 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7b27578c-3dca-498b-8097-ea69fe0bb2c0 tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:22.839122 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7b27578c-3dca-498b-8097-ea69fe0bb2c0 tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:23.115768 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-337bd928-d9a3-4b9d-837b-cdcba8aa4e28 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d86f09c6304121be2021cb5c15e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ab544d0b547919794e3efb49ba0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:33:23.124274 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-337bd928-d9a3-4b9d-837b-cdcba8aa4e28 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940" status: 200 len: 1522 microversion: 2.1 time: 0.438847 Sep 09 16:33:23.131812 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 123/244] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:33:22 2022] GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940 => generated 1522 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:33:23.133724 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-08b3c269-df2c-49d7-8adf-33f1ddeafcd6 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:33:23.134337 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-08b3c269-df2c-49d7-8adf-33f1ddeafcd6 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] [instance: 90c05260-2024-4606-925b-8e63442113f7] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:33:23.141210 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-08b3c269-df2c-49d7-8adf-33f1ddeafcd6 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:23.141715 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-08b3c269-df2c-49d7-8adf-33f1ddeafcd6 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:23.142114 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-08b3c269-df2c-49d7-8adf-33f1ddeafcd6 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:23.142856 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-08b3c269-df2c-49d7-8adf-33f1ddeafcd6 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:23.143300 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-08b3c269-df2c-49d7-8adf-33f1ddeafcd6 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:23.143918 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-08b3c269-df2c-49d7-8adf-33f1ddeafcd6 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:23.404545 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-7b27578c-3dca-498b-8097-ea69fe0bb2c0 tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e16e344f43f4fb8bf89e5fa9cd4a338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7bd597164874d2ca0c716694156cc03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:33:23.431000 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-08b3c269-df2c-49d7-8adf-33f1ddeafcd6 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2fbc3668cf4a82b8eea0b67b87ca80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9243cdc25d5444d847db4f59c05fa6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:33:23.431267 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-7b27578c-3dca-498b-8097-ea69fe0bb2c0 tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] 10.222.0.23 "GET /compute/v2.1/servers/f86519e0-2abf-4492-b504-eb4177c1cac5" status: 200 len: 1315 microversion: 2.1 time: 0.616459 Sep 09 16:33:23.435392 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 122/245] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:33:22 2022] GET /compute/v2.1/servers/f86519e0-2abf-4492-b504-eb4177c1cac5 => generated 1315 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 16:33:23.455466 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-08b3c269-df2c-49d7-8adf-33f1ddeafcd6 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] 10.222.0.23 "GET /compute/v2.1/servers/90c05260-2024-4606-925b-8e63442113f7" status: 200 len: 1313 microversion: 2.1 time: 0.328233 Sep 09 16:33:23.456283 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 124/246] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:33:23 2022] GET /compute/v2.1/servers/90c05260-2024-4606-925b-8e63442113f7 => generated 1313 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:33:23.843589 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [req-07ba12a5-0d1c-45b1-a899-87a48eca98b9 req-71ebf6b3-b4a6-4807-adfa-64c8644321a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f86519e0-2abf-4492-b504-eb4177c1cac5", "tag": "b99ef884-0920-460f-90c3-8c391d9ac7b7"}]} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:33:23.872728 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-07ba12a5-0d1c-45b1-a899-87a48eca98b9 req-71ebf6b3-b4a6-4807-adfa-64c8644321a8 service nova] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:23.873572 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-07ba12a5-0d1c-45b1-a899-87a48eca98b9 req-71ebf6b3-b4a6-4807-adfa-64c8644321a8 service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:23.874186 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-07ba12a5-0d1c-45b1-a899-87a48eca98b9 req-71ebf6b3-b4a6-4807-adfa-64c8644321a8 service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:23.898143 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.compute.server_external_events [req-07ba12a5-0d1c-45b1-a899-87a48eca98b9 req-71ebf6b3-b4a6-4807-adfa-64c8644321a8 service nova] Creating event network-changed:b99ef884-0920-460f-90c3-8c391d9ac7b7 for instance f86519e0-2abf-4492-b504-eb4177c1cac5 on hv-cinder-83124 Sep 09 16:33:23.906366 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [req-07ba12a5-0d1c-45b1-a899-87a48eca98b9 req-71ebf6b3-b4a6-4807-adfa-64c8644321a8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065737 Sep 09 16:33:23.911888 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 123/247] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Sep 9 16:33:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:33:24.150121 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-e001ca64-8636-457e-857a-380376cc1af6 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:33:24.150747 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-e001ca64-8636-457e-857a-380376cc1af6 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: e8d23cb3-2f39-4b00-ae9d-006e392a5940] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:33:24.163406 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e001ca64-8636-457e-857a-380376cc1af6 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:24.164289 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e001ca64-8636-457e-857a-380376cc1af6 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:24.167790 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e001ca64-8636-457e-857a-380376cc1af6 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:24.168537 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e001ca64-8636-457e-857a-380376cc1af6 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:24.175617 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e001ca64-8636-457e-857a-380376cc1af6 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:24.176136 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e001ca64-8636-457e-857a-380376cc1af6 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:24.436958 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-e001ca64-8636-457e-857a-380376cc1af6 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d86f09c6304121be2021cb5c15e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ab544d0b547919794e3efb49ba0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:33:24.455722 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-63ed10f0-5095-49ea-9b39-02aac4c538a3 tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:33:24.456681 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-e001ca64-8636-457e-857a-380376cc1af6 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940" status: 200 len: 1522 microversion: 2.1 time: 0.311779 Sep 09 16:33:24.456841 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-63ed10f0-5095-49ea-9b39-02aac4c538a3 tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] [instance: f86519e0-2abf-4492-b504-eb4177c1cac5] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:33:24.457318 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 125/248] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:33:24 2022] GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940 => generated 1522 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:33:24.464232 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-63ed10f0-5095-49ea-9b39-02aac4c538a3 tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:24.468449 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-63ed10f0-5095-49ea-9b39-02aac4c538a3 tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:24.469099 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-63ed10f0-5095-49ea-9b39-02aac4c538a3 tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:24.470149 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-63ed10f0-5095-49ea-9b39-02aac4c538a3 tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:24.470843 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-63ed10f0-5095-49ea-9b39-02aac4c538a3 tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:24.471496 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-63ed10f0-5095-49ea-9b39-02aac4c538a3 tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:24.478348 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-f9563978-92fc-48e2-95d7-4fe3ddd1d7f5 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:33:24.479471 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-f9563978-92fc-48e2-95d7-4fe3ddd1d7f5 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] [instance: 90c05260-2024-4606-925b-8e63442113f7] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:33:24.491005 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f9563978-92fc-48e2-95d7-4fe3ddd1d7f5 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:24.491714 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f9563978-92fc-48e2-95d7-4fe3ddd1d7f5 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:24.492501 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f9563978-92fc-48e2-95d7-4fe3ddd1d7f5 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:24.493462 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f9563978-92fc-48e2-95d7-4fe3ddd1d7f5 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:24.494427 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f9563978-92fc-48e2-95d7-4fe3ddd1d7f5 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:24.495154 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f9563978-92fc-48e2-95d7-4fe3ddd1d7f5 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:24.727662 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-63ed10f0-5095-49ea-9b39-02aac4c538a3 tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e16e344f43f4fb8bf89e5fa9cd4a338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7bd597164874d2ca0c716694156cc03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:33:24.731105 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-f9563978-92fc-48e2-95d7-4fe3ddd1d7f5 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2fbc3668cf4a82b8eea0b67b87ca80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9243cdc25d5444d847db4f59c05fa6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:33:24.737437 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-63ed10f0-5095-49ea-9b39-02aac4c538a3 tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] 10.222.0.23 "GET /compute/v2.1/servers/f86519e0-2abf-4492-b504-eb4177c1cac5" status: 200 len: 1315 microversion: 2.1 time: 0.285871 Sep 09 16:33:24.738921 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 124/249] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:33:24 2022] GET /compute/v2.1/servers/f86519e0-2abf-4492-b504-eb4177c1cac5 => generated 1315 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 16:33:24.740294 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-f9563978-92fc-48e2-95d7-4fe3ddd1d7f5 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] 10.222.0.23 "GET /compute/v2.1/servers/90c05260-2024-4606-925b-8e63442113f7" status: 200 len: 1313 microversion: 2.1 time: 0.266039 Sep 09 16:33:24.740864 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 126/250] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:33:24 2022] GET /compute/v2.1/servers/90c05260-2024-4606-925b-8e63442113f7 => generated 1313 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:33:25.482894 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-c27f0ac8-3c10-4ed6-97dc-bb08ed15c33e tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:33:25.483643 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-c27f0ac8-3c10-4ed6-97dc-bb08ed15c33e tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: e8d23cb3-2f39-4b00-ae9d-006e392a5940] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:33:25.496868 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c27f0ac8-3c10-4ed6-97dc-bb08ed15c33e tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:25.497415 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c27f0ac8-3c10-4ed6-97dc-bb08ed15c33e tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:25.498345 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c27f0ac8-3c10-4ed6-97dc-bb08ed15c33e tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:25.499917 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c27f0ac8-3c10-4ed6-97dc-bb08ed15c33e tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:25.500366 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c27f0ac8-3c10-4ed6-97dc-bb08ed15c33e tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:25.500806 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c27f0ac8-3c10-4ed6-97dc-bb08ed15c33e tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:25.646836 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-c27f0ac8-3c10-4ed6-97dc-bb08ed15c33e tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d86f09c6304121be2021cb5c15e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ab544d0b547919794e3efb49ba0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:33:25.655649 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-c27f0ac8-3c10-4ed6-97dc-bb08ed15c33e tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940" status: 200 len: 1522 microversion: 2.1 time: 0.178119 Sep 09 16:33:25.656060 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 125/251] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:33:25 2022] GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940 => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:33:25.764910 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-720a0658-804b-4b8f-a830-74288aa25e8f tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:33:25.768216 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-2e3d1d5c-920c-49c8-a8c8-fc587d407d3a tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:33:25.769044 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-2e3d1d5c-920c-49c8-a8c8-fc587d407d3a tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] [instance: 90c05260-2024-4606-925b-8e63442113f7] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:33:25.770591 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-720a0658-804b-4b8f-a830-74288aa25e8f tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] [instance: f86519e0-2abf-4492-b504-eb4177c1cac5] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:33:25.780640 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-720a0658-804b-4b8f-a830-74288aa25e8f tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:25.782221 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2e3d1d5c-920c-49c8-a8c8-fc587d407d3a tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:25.782734 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2e3d1d5c-920c-49c8-a8c8-fc587d407d3a tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:25.783156 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2e3d1d5c-920c-49c8-a8c8-fc587d407d3a tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:25.783847 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2e3d1d5c-920c-49c8-a8c8-fc587d407d3a tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:25.784500 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-720a0658-804b-4b8f-a830-74288aa25e8f tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:25.784923 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-720a0658-804b-4b8f-a830-74288aa25e8f tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:25.785606 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-720a0658-804b-4b8f-a830-74288aa25e8f tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:25.786229 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-720a0658-804b-4b8f-a830-74288aa25e8f tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:25.786885 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2e3d1d5c-920c-49c8-a8c8-fc587d407d3a tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:25.787302 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2e3d1d5c-920c-49c8-a8c8-fc587d407d3a tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:25.791998 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-720a0658-804b-4b8f-a830-74288aa25e8f tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:26.062949 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-720a0658-804b-4b8f-a830-74288aa25e8f tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e16e344f43f4fb8bf89e5fa9cd4a338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7bd597164874d2ca0c716694156cc03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:33:26.071552 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-720a0658-804b-4b8f-a830-74288aa25e8f tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] 10.222.0.23 "GET /compute/v2.1/servers/f86519e0-2abf-4492-b504-eb4177c1cac5" status: 200 len: 1315 microversion: 2.1 time: 0.313804 Sep 09 16:33:26.087625 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 127/252] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:33:25 2022] GET /compute/v2.1/servers/f86519e0-2abf-4492-b504-eb4177c1cac5 => generated 1315 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:33:26.095563 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [req-1feacb8f-955c-40c8-9cda-8964959f8f4d req-a598f19b-9002-45da-8503-4b3313a62ab2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90c05260-2024-4606-925b-8e63442113f7", "name": "network-vif-plugged", "status": "completed", "tag": "0df0e967-b65d-4297-9c81-63241dbcb10e"}]} {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:33:26.110634 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [req-1feacb8f-955c-40c8-9cda-8964959f8f4d req-a598f19b-9002-45da-8503-4b3313a62ab2 service nova] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:26.111118 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [req-1feacb8f-955c-40c8-9cda-8964959f8f4d req-a598f19b-9002-45da-8503-4b3313a62ab2 service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:26.112054 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [req-1feacb8f-955c-40c8-9cda-8964959f8f4d req-a598f19b-9002-45da-8503-4b3313a62ab2 service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:26.124709 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.compute.server_external_events [req-1feacb8f-955c-40c8-9cda-8964959f8f4d req-a598f19b-9002-45da-8503-4b3313a62ab2 service nova] Creating event network-vif-plugged:0df0e967-b65d-4297-9c81-63241dbcb10e for instance 90c05260-2024-4606-925b-8e63442113f7 on hv-cinder-83124 Sep 09 16:33:26.130974 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [req-1feacb8f-955c-40c8-9cda-8964959f8f4d req-a598f19b-9002-45da-8503-4b3313a62ab2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041891 Sep 09 16:33:26.132009 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 128/253] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Sep 9 16:33:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:33:26.216569 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-2e3d1d5c-920c-49c8-a8c8-fc587d407d3a tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2fbc3668cf4a82b8eea0b67b87ca80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9243cdc25d5444d847db4f59c05fa6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:33:26.226000 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-2e3d1d5c-920c-49c8-a8c8-fc587d407d3a tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] 10.222.0.23 "GET /compute/v2.1/servers/90c05260-2024-4606-925b-8e63442113f7" status: 200 len: 1313 microversion: 2.1 time: 0.467338 Sep 09 16:33:26.227090 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 126/254] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:33:25 2022] GET /compute/v2.1/servers/90c05260-2024-4606-925b-8e63442113f7 => generated 1313 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:33:26.679926 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-eeed9c52-fa77-4731-bb9d-16406ce672b8 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:33:26.680628 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-eeed9c52-fa77-4731-bb9d-16406ce672b8 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: e8d23cb3-2f39-4b00-ae9d-006e392a5940] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:33:26.695908 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-eeed9c52-fa77-4731-bb9d-16406ce672b8 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:26.696450 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-eeed9c52-fa77-4731-bb9d-16406ce672b8 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:26.696877 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-eeed9c52-fa77-4731-bb9d-16406ce672b8 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:26.698660 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-eeed9c52-fa77-4731-bb9d-16406ce672b8 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:26.699301 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-eeed9c52-fa77-4731-bb9d-16406ce672b8 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:26.699734 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-eeed9c52-fa77-4731-bb9d-16406ce672b8 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:26.903445 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-eeed9c52-fa77-4731-bb9d-16406ce672b8 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d86f09c6304121be2021cb5c15e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ab544d0b547919794e3efb49ba0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:33:26.911986 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-eeed9c52-fa77-4731-bb9d-16406ce672b8 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940" status: 200 len: 1522 microversion: 2.1 time: 0.236492 Sep 09 16:33:26.912940 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 129/255] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:33:26 2022] GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940 => generated 1522 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:33:27.097444 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-1836346c-b66a-4e8d-950b-c73994bc11e8 tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:33:27.098283 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-1836346c-b66a-4e8d-950b-c73994bc11e8 tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] [instance: f86519e0-2abf-4492-b504-eb4177c1cac5] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:33:27.105200 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1836346c-b66a-4e8d-950b-c73994bc11e8 tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:27.105909 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1836346c-b66a-4e8d-950b-c73994bc11e8 tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:27.106338 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1836346c-b66a-4e8d-950b-c73994bc11e8 tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:27.107066 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1836346c-b66a-4e8d-950b-c73994bc11e8 tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:27.107515 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1836346c-b66a-4e8d-950b-c73994bc11e8 tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:27.107929 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1836346c-b66a-4e8d-950b-c73994bc11e8 tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:27.249629 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-cc09b7fe-8a98-40a5-b5dc-a88f2517fa38 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:33:27.250565 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-cc09b7fe-8a98-40a5-b5dc-a88f2517fa38 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] [instance: 90c05260-2024-4606-925b-8e63442113f7] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:33:27.255386 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-1836346c-b66a-4e8d-950b-c73994bc11e8 tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e16e344f43f4fb8bf89e5fa9cd4a338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7bd597164874d2ca0c716694156cc03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:33:27.257672 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-cc09b7fe-8a98-40a5-b5dc-a88f2517fa38 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:27.258551 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-cc09b7fe-8a98-40a5-b5dc-a88f2517fa38 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:27.259464 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-cc09b7fe-8a98-40a5-b5dc-a88f2517fa38 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:27.260454 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-cc09b7fe-8a98-40a5-b5dc-a88f2517fa38 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:27.261158 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-cc09b7fe-8a98-40a5-b5dc-a88f2517fa38 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:27.262202 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-cc09b7fe-8a98-40a5-b5dc-a88f2517fa38 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:27.269646 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-1836346c-b66a-4e8d-950b-c73994bc11e8 tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] 10.222.0.23 "GET /compute/v2.1/servers/f86519e0-2abf-4492-b504-eb4177c1cac5" status: 200 len: 1315 microversion: 2.1 time: 0.175999 Sep 09 16:33:27.271013 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 127/256] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:33:27 2022] GET /compute/v2.1/servers/f86519e0-2abf-4492-b504-eb4177c1cac5 => generated 1315 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 16:33:27.430473 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-cc09b7fe-8a98-40a5-b5dc-a88f2517fa38 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2fbc3668cf4a82b8eea0b67b87ca80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9243cdc25d5444d847db4f59c05fa6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:33:27.439425 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-cc09b7fe-8a98-40a5-b5dc-a88f2517fa38 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] 10.222.0.23 "GET /compute/v2.1/servers/90c05260-2024-4606-925b-8e63442113f7" status: 200 len: 1313 microversion: 2.1 time: 0.193788 Sep 09 16:33:27.440018 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 130/257] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:33:27 2022] GET /compute/v2.1/servers/90c05260-2024-4606-925b-8e63442113f7 => generated 1313 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 16:33:27.936435 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-999b7552-2f51-4e9e-81a0-cb41151df96b tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:33:27.937273 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-999b7552-2f51-4e9e-81a0-cb41151df96b tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: e8d23cb3-2f39-4b00-ae9d-006e392a5940] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:33:27.940052 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell0:SELECT=2 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:33:27.950051 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-999b7552-2f51-4e9e-81a0-cb41151df96b tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:27.953677 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-999b7552-2f51-4e9e-81a0-cb41151df96b tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:27.954401 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-999b7552-2f51-4e9e-81a0-cb41151df96b tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:27.955413 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-999b7552-2f51-4e9e-81a0-cb41151df96b tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:27.955986 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-999b7552-2f51-4e9e-81a0-cb41151df96b tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:27.956510 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-999b7552-2f51-4e9e-81a0-cb41151df96b tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:28.181267 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [req-92eb626c-ca36-4293-96cd-73e951b438eb req-59cd75ca-7cd9-4612-b827-f41b917b99ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f86519e0-2abf-4492-b504-eb4177c1cac5", "name": "network-vif-plugged", "status": "completed", "tag": "b99ef884-0920-460f-90c3-8c391d9ac7b7"}]} {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:33:28.187635 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-999b7552-2f51-4e9e-81a0-cb41151df96b tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d86f09c6304121be2021cb5c15e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ab544d0b547919794e3efb49ba0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:33:28.196746 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-999b7552-2f51-4e9e-81a0-cb41151df96b tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940" status: 200 len: 1522 microversion: 2.1 time: 0.264736 Sep 09 16:33:28.197724 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 128/258] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:33:27 2022] GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940 => generated 1522 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:33:28.198014 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [req-92eb626c-ca36-4293-96cd-73e951b438eb req-59cd75ca-7cd9-4612-b827-f41b917b99ed service nova] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:28.199486 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [req-92eb626c-ca36-4293-96cd-73e951b438eb req-59cd75ca-7cd9-4612-b827-f41b917b99ed service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:28.199954 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [req-92eb626c-ca36-4293-96cd-73e951b438eb req-59cd75ca-7cd9-4612-b827-f41b917b99ed service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:28.213150 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.compute.server_external_events [req-92eb626c-ca36-4293-96cd-73e951b438eb req-59cd75ca-7cd9-4612-b827-f41b917b99ed service nova] Creating event network-vif-plugged:b99ef884-0920-460f-90c3-8c391d9ac7b7 for instance f86519e0-2abf-4492-b504-eb4177c1cac5 on hv-cinder-83124 Sep 09 16:33:28.225010 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [req-92eb626c-ca36-4293-96cd-73e951b438eb req-59cd75ca-7cd9-4612-b827-f41b917b99ed service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047452 Sep 09 16:33:28.230734 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 131/259] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Sep 9 16:33:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:33:28.295577 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-699ebd63-7051-4087-893b-4632821e26ed tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:33:28.297023 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-699ebd63-7051-4087-893b-4632821e26ed tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] [instance: f86519e0-2abf-4492-b504-eb4177c1cac5] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:33:28.306431 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-699ebd63-7051-4087-893b-4632821e26ed tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:28.307474 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-699ebd63-7051-4087-893b-4632821e26ed tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:28.309131 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-699ebd63-7051-4087-893b-4632821e26ed tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:28.310153 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-699ebd63-7051-4087-893b-4632821e26ed tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:28.310875 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-699ebd63-7051-4087-893b-4632821e26ed tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:28.311505 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-699ebd63-7051-4087-893b-4632821e26ed tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:28.462855 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-0bae0f0d-9dce-4ed9-9c50-243c6cd45f4c tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:33:28.463534 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-0bae0f0d-9dce-4ed9-9c50-243c6cd45f4c tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] [instance: 90c05260-2024-4606-925b-8e63442113f7] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:33:28.475884 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-0bae0f0d-9dce-4ed9-9c50-243c6cd45f4c tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:28.476965 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-0bae0f0d-9dce-4ed9-9c50-243c6cd45f4c tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:28.483199 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-0bae0f0d-9dce-4ed9-9c50-243c6cd45f4c tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:28.484221 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-0bae0f0d-9dce-4ed9-9c50-243c6cd45f4c tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:28.485498 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-0bae0f0d-9dce-4ed9-9c50-243c6cd45f4c tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:28.486107 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-0bae0f0d-9dce-4ed9-9c50-243c6cd45f4c tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:28.587676 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-699ebd63-7051-4087-893b-4632821e26ed tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e16e344f43f4fb8bf89e5fa9cd4a338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7bd597164874d2ca0c716694156cc03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:33:28.601915 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-699ebd63-7051-4087-893b-4632821e26ed tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] 10.222.0.23 "GET /compute/v2.1/servers/f86519e0-2abf-4492-b504-eb4177c1cac5" status: 200 len: 1315 microversion: 2.1 time: 0.311741 Sep 09 16:33:28.604449 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 129/260] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:33:28 2022] GET /compute/v2.1/servers/f86519e0-2abf-4492-b504-eb4177c1cac5 => generated 1315 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:33:28.711639 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-0bae0f0d-9dce-4ed9-9c50-243c6cd45f4c tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2fbc3668cf4a82b8eea0b67b87ca80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9243cdc25d5444d847db4f59c05fa6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:33:28.720922 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-0bae0f0d-9dce-4ed9-9c50-243c6cd45f4c tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] 10.222.0.23 "GET /compute/v2.1/servers/90c05260-2024-4606-925b-8e63442113f7" status: 200 len: 1498 microversion: 2.1 time: 0.262280 Sep 09 16:33:28.721986 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 132/261] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:33:28 2022] GET /compute/v2.1/servers/90c05260-2024-4606-925b-8e63442113f7 => generated 1498 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:33:29.233390 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-70bf3b56-b24e-4380-a300-2e788e813b40 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:33:29.236519 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-70bf3b56-b24e-4380-a300-2e788e813b40 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: e8d23cb3-2f39-4b00-ae9d-006e392a5940] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:33:29.256513 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-70bf3b56-b24e-4380-a300-2e788e813b40 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:29.257417 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-70bf3b56-b24e-4380-a300-2e788e813b40 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:29.258257 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-70bf3b56-b24e-4380-a300-2e788e813b40 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:29.259488 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-70bf3b56-b24e-4380-a300-2e788e813b40 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:29.260412 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-70bf3b56-b24e-4380-a300-2e788e813b40 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:29.261150 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-70bf3b56-b24e-4380-a300-2e788e813b40 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:29.408833 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-cd9d726b-0338-496d-a821-8cc6523fd55f tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:33:29.409531 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-cd9d726b-0338-496d-a821-8cc6523fd55f tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] [instance: 90c05260-2024-4606-925b-8e63442113f7] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:33:29.411813 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG dbcounter [-] [127196] Writing DB stats nova_cell0:SELECT=2 {{(pid=127196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:33:29.412717 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG dbcounter [-] [127196] Writing DB stats nova_cell0:SELECT=8 {{(pid=127196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:33:29.445005 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-cd9d726b-0338-496d-a821-8cc6523fd55f tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:29.447133 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-cd9d726b-0338-496d-a821-8cc6523fd55f tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:29.447605 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-cd9d726b-0338-496d-a821-8cc6523fd55f tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:29.448335 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-cd9d726b-0338-496d-a821-8cc6523fd55f tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:29.453913 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-cd9d726b-0338-496d-a821-8cc6523fd55f tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:29.459884 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-cd9d726b-0338-496d-a821-8cc6523fd55f tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:29.462864 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell0:SELECT=8 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:33:29.491542 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-70bf3b56-b24e-4380-a300-2e788e813b40 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d86f09c6304121be2021cb5c15e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ab544d0b547919794e3efb49ba0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:33:29.511545 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-70bf3b56-b24e-4380-a300-2e788e813b40 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940" status: 200 len: 1522 microversion: 2.1 time: 0.292600 Sep 09 16:33:29.524905 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 130/262] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:33:29 2022] GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940 => generated 1522 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:33:29.532662 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-cd9d726b-0338-496d-a821-8cc6523fd55f tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] [instance: 90c05260-2024-4606-925b-8e63442113f7] Going to try to terminate instance {{(pid=127196) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 16:33:29.625892 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-9a93e39a-4d9b-4e7d-badb-736276387087 tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:33:29.626708 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-9a93e39a-4d9b-4e7d-badb-736276387087 tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] [instance: f86519e0-2abf-4492-b504-eb4177c1cac5] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:33:29.633767 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9a93e39a-4d9b-4e7d-badb-736276387087 tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:29.634261 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9a93e39a-4d9b-4e7d-badb-736276387087 tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:29.635180 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9a93e39a-4d9b-4e7d-badb-736276387087 tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:29.635624 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9a93e39a-4d9b-4e7d-badb-736276387087 tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:29.636248 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9a93e39a-4d9b-4e7d-badb-736276387087 tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:29.636786 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9a93e39a-4d9b-4e7d-badb-736276387087 tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:29.702843 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-cd9d726b-0338-496d-a821-8cc6523fd55f tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] 10.222.0.23 "DELETE /compute/v2.1/servers/90c05260-2024-4606-925b-8e63442113f7" status: 204 len: 0 microversion: 2.1 time: 0.296786 Sep 09 16:33:29.705225 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 133/263] 10.222.0.23 () {58 vars in 1239 bytes} [Fri Sep 9 16:33:29 2022] DELETE /compute/v2.1/servers/90c05260-2024-4606-925b-8e63442113f7 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 16:33:29.714994 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-ecc14832-07a9-4a10-986c-9a7b37bcaf83 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:33:29.731656 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-ecc14832-07a9-4a10-986c-9a7b37bcaf83 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] [instance: 90c05260-2024-4606-925b-8e63442113f7] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:33:29.737944 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-ecc14832-07a9-4a10-986c-9a7b37bcaf83 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:29.738564 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-ecc14832-07a9-4a10-986c-9a7b37bcaf83 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:29.739105 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-ecc14832-07a9-4a10-986c-9a7b37bcaf83 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:29.739818 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-ecc14832-07a9-4a10-986c-9a7b37bcaf83 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:29.740267 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-ecc14832-07a9-4a10-986c-9a7b37bcaf83 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:29.740678 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-ecc14832-07a9-4a10-986c-9a7b37bcaf83 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:30.006725 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-9a93e39a-4d9b-4e7d-badb-736276387087 tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e16e344f43f4fb8bf89e5fa9cd4a338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7bd597164874d2ca0c716694156cc03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:33:30.019311 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-9a93e39a-4d9b-4e7d-badb-736276387087 tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] 10.222.0.23 "GET /compute/v2.1/servers/f86519e0-2abf-4492-b504-eb4177c1cac5" status: 200 len: 1315 microversion: 2.1 time: 0.397650 Sep 09 16:33:30.019910 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 131/264] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:33:29 2022] GET /compute/v2.1/servers/f86519e0-2abf-4492-b504-eb4177c1cac5 => generated 1315 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:33:30.098694 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-ecc14832-07a9-4a10-986c-9a7b37bcaf83 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2fbc3668cf4a82b8eea0b67b87ca80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9243cdc25d5444d847db4f59c05fa6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:33:30.112344 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-ecc14832-07a9-4a10-986c-9a7b37bcaf83 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] 10.222.0.23 "GET /compute/v2.1/servers/90c05260-2024-4606-925b-8e63442113f7" status: 200 len: 1504 microversion: 2.1 time: 0.401527 Sep 09 16:33:30.121439 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 134/265] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:33:29 2022] GET /compute/v2.1/servers/90c05260-2024-4606-925b-8e63442113f7 => generated 1504 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:33:30.540391 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-fd85f127-70db-4ba1-83a4-76ca08199068 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:33:30.542885 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-fd85f127-70db-4ba1-83a4-76ca08199068 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: e8d23cb3-2f39-4b00-ae9d-006e392a5940] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:33:30.550939 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fd85f127-70db-4ba1-83a4-76ca08199068 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:30.551956 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fd85f127-70db-4ba1-83a4-76ca08199068 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:30.552618 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fd85f127-70db-4ba1-83a4-76ca08199068 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:30.553581 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fd85f127-70db-4ba1-83a4-76ca08199068 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:30.554255 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fd85f127-70db-4ba1-83a4-76ca08199068 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:30.555194 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fd85f127-70db-4ba1-83a4-76ca08199068 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:30.732955 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-fd85f127-70db-4ba1-83a4-76ca08199068 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d86f09c6304121be2021cb5c15e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ab544d0b547919794e3efb49ba0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:33:30.740973 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-fd85f127-70db-4ba1-83a4-76ca08199068 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940" status: 200 len: 1522 microversion: 2.1 time: 0.205210 Sep 09 16:33:30.741532 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 132/266] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:33:30 2022] GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940 => generated 1522 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:33:30.947620 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-ef510033-ff70-4893-a87f-ee13d25fef56 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Action: 'create', calling method: .version_select at 0x7f24fb7d60d0>, body: {"keypair": {"name": "tempest-keypair-1808603169", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBConEtaSbQifCz1xim4CEUHkXozf5HgZNBNvWjh+sNsadzZn73tRfTSEYUHbqbn0xitWZWVwNfQgDIfek1qxTbRA4ouFIA1+f+jeSie+cZrU8zh8MxkdeC1kAr0MwD2wfg=="}} {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:33:30.968011 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.quota [None req-ef510033-ff70-4893-a87f-ee13d25fef56 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Getting quotas for project 3fca9208950f4d1a92bd52b4e5f5b2a1. Resources: {'key_pairs'} {{(pid=127196) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 16:33:30.971840 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.quota [None req-ef510033-ff70-4893-a87f-ee13d25fef56 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Getting quotas for user f8bd900e231242c3ae67432d26d089da and project 3fca9208950f4d1a92bd52b4e5f5b2a1. Resources: {'key_pairs'} {{(pid=127196) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 16:33:31.009988 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-ef510033-ff70-4893-a87f-ee13d25fef56 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.195790 Sep 09 16:33:31.010705 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 135/267] 10.222.0.23 () {62 vars in 1200 bytes} [Fri Sep 9 16:33:30 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 197 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 09 16:33:31.041654 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-77782ff4-0019-48db-8660-ca181a18f10f tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:33:31.042177 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-77782ff4-0019-48db-8660-ca181a18f10f tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] [instance: f86519e0-2abf-4492-b504-eb4177c1cac5] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:33:31.052546 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-77782ff4-0019-48db-8660-ca181a18f10f tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:31.053041 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-77782ff4-0019-48db-8660-ca181a18f10f tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:31.053479 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-77782ff4-0019-48db-8660-ca181a18f10f tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:31.054186 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-77782ff4-0019-48db-8660-ca181a18f10f tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:31.054674 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-77782ff4-0019-48db-8660-ca181a18f10f tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:31.055099 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-77782ff4-0019-48db-8660-ca181a18f10f tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:31.137034 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-0b8d2d4d-7200-4f81-bd6e-e721203a4601 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:33:31.137816 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-0b8d2d4d-7200-4f81-bd6e-e721203a4601 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] [instance: 90c05260-2024-4606-925b-8e63442113f7] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:33:31.144415 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-0b8d2d4d-7200-4f81-bd6e-e721203a4601 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:31.145006 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-0b8d2d4d-7200-4f81-bd6e-e721203a4601 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:31.145722 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-0b8d2d4d-7200-4f81-bd6e-e721203a4601 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:31.146360 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-0b8d2d4d-7200-4f81-bd6e-e721203a4601 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:31.146968 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-0b8d2d4d-7200-4f81-bd6e-e721203a4601 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:31.147596 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-0b8d2d4d-7200-4f81-bd6e-e721203a4601 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:31.340449 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-77782ff4-0019-48db-8660-ca181a18f10f tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e16e344f43f4fb8bf89e5fa9cd4a338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7bd597164874d2ca0c716694156cc03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:33:31.351442 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-77782ff4-0019-48db-8660-ca181a18f10f tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] 10.222.0.23 "GET /compute/v2.1/servers/f86519e0-2abf-4492-b504-eb4177c1cac5" status: 200 len: 1315 microversion: 2.1 time: 0.313881 Sep 09 16:33:31.352856 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 133/268] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:33:31 2022] GET /compute/v2.1/servers/f86519e0-2abf-4492-b504-eb4177c1cac5 => generated 1315 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:33:31.403132 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-0b8d2d4d-7200-4f81-bd6e-e721203a4601 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2fbc3668cf4a82b8eea0b67b87ca80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9243cdc25d5444d847db4f59c05fa6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:33:31.407885 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG dbcounter [-] [127196] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:33:31.422627 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-0b8d2d4d-7200-4f81-bd6e-e721203a4601 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] 10.222.0.23 "GET /compute/v2.1/servers/90c05260-2024-4606-925b-8e63442113f7" status: 200 len: 1504 microversion: 2.1 time: 0.289160 Sep 09 16:33:31.423419 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 136/269] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:33:31 2022] GET /compute/v2.1/servers/90c05260-2024-4606-925b-8e63442113f7 => generated 1504 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 16:33:31.764675 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-77cfc205-fadd-468f-b151-d9e56603a45d tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:33:31.765868 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-77cfc205-fadd-468f-b151-d9e56603a45d tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: e8d23cb3-2f39-4b00-ae9d-006e392a5940] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:33:31.773502 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-77cfc205-fadd-468f-b151-d9e56603a45d tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:31.774216 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-77cfc205-fadd-468f-b151-d9e56603a45d tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:31.774837 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-77cfc205-fadd-468f-b151-d9e56603a45d tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:31.775540 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-77cfc205-fadd-468f-b151-d9e56603a45d tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:31.775991 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-77cfc205-fadd-468f-b151-d9e56603a45d tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:31.776410 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-77cfc205-fadd-468f-b151-d9e56603a45d tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:31.977462 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-77cfc205-fadd-468f-b151-d9e56603a45d tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d86f09c6304121be2021cb5c15e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ab544d0b547919794e3efb49ba0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:33:31.986312 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-77cfc205-fadd-468f-b151-d9e56603a45d tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940" status: 200 len: 1522 microversion: 2.1 time: 0.225537 Sep 09 16:33:31.998086 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 134/270] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:33:31 2022] GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940 => generated 1522 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:33:32.383379 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-cff90315-b70a-4483-b18d-75a13fc30f8c tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:33:32.385380 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-cff90315-b70a-4483-b18d-75a13fc30f8c tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] [instance: f86519e0-2abf-4492-b504-eb4177c1cac5] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:33:32.393561 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-cff90315-b70a-4483-b18d-75a13fc30f8c tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:32.395259 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-cff90315-b70a-4483-b18d-75a13fc30f8c tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:32.396396 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-cff90315-b70a-4483-b18d-75a13fc30f8c tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:32.397215 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-cff90315-b70a-4483-b18d-75a13fc30f8c tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:32.397827 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-cff90315-b70a-4483-b18d-75a13fc30f8c tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:32.398424 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-cff90315-b70a-4483-b18d-75a13fc30f8c tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:32.445482 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-db778ffb-7c83-43dd-a194-df2f89b8f638 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:33:32.446212 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-db778ffb-7c83-43dd-a194-df2f89b8f638 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] [instance: 90c05260-2024-4606-925b-8e63442113f7] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:33:32.452541 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-db778ffb-7c83-43dd-a194-df2f89b8f638 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:32.453128 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-db778ffb-7c83-43dd-a194-df2f89b8f638 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:32.453617 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-db778ffb-7c83-43dd-a194-df2f89b8f638 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:32.454417 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-db778ffb-7c83-43dd-a194-df2f89b8f638 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:32.454967 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-db778ffb-7c83-43dd-a194-df2f89b8f638 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:32.455447 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-db778ffb-7c83-43dd-a194-df2f89b8f638 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:32.976252 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-db778ffb-7c83-43dd-a194-df2f89b8f638 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2fbc3668cf4a82b8eea0b67b87ca80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9243cdc25d5444d847db4f59c05fa6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:33:32.979065 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-cff90315-b70a-4483-b18d-75a13fc30f8c tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e16e344f43f4fb8bf89e5fa9cd4a338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7bd597164874d2ca0c716694156cc03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:33:32.995728 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-cff90315-b70a-4483-b18d-75a13fc30f8c tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] 10.222.0.23 "GET /compute/v2.1/servers/f86519e0-2abf-4492-b504-eb4177c1cac5" status: 200 len: 1465 microversion: 2.1 time: 0.625044 Sep 09 16:33:32.997628 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-db778ffb-7c83-43dd-a194-df2f89b8f638 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] 10.222.0.23 "GET /compute/v2.1/servers/90c05260-2024-4606-925b-8e63442113f7" status: 200 len: 1504 microversion: 2.1 time: 0.555985 Sep 09 16:33:32.998829 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 137/271] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:33:32 2022] GET /compute/v2.1/servers/f86519e0-2abf-4492-b504-eb4177c1cac5 => generated 1465 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:33:33.011881 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 135/272] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:33:32 2022] GET /compute/v2.1/servers/90c05260-2024-4606-925b-8e63442113f7 => generated 1504 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 16:33:33.023571 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-aadbbdc6-1cdc-4d4d-b788-85228ebe2d62 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:33:33.024365 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-aadbbdc6-1cdc-4d4d-b788-85228ebe2d62 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: e8d23cb3-2f39-4b00-ae9d-006e392a5940] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:33:33.030212 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-aadbbdc6-1cdc-4d4d-b788-85228ebe2d62 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:33.030737 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-aadbbdc6-1cdc-4d4d-b788-85228ebe2d62 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:33.031168 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-aadbbdc6-1cdc-4d4d-b788-85228ebe2d62 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:33.031910 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-aadbbdc6-1cdc-4d4d-b788-85228ebe2d62 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:33.032382 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-aadbbdc6-1cdc-4d4d-b788-85228ebe2d62 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:33.032781 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-aadbbdc6-1cdc-4d4d-b788-85228ebe2d62 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:33.060738 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-5e364561-2464-4733-b8f2-2c94f9741bb9 tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:33:33.061648 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-5e364561-2464-4733-b8f2-2c94f9741bb9 tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] [instance: f86519e0-2abf-4492-b504-eb4177c1cac5] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:33:33.068205 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5e364561-2464-4733-b8f2-2c94f9741bb9 tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:33.068998 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5e364561-2464-4733-b8f2-2c94f9741bb9 tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:33.069645 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5e364561-2464-4733-b8f2-2c94f9741bb9 tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:33.070604 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5e364561-2464-4733-b8f2-2c94f9741bb9 tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:33.071402 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5e364561-2464-4733-b8f2-2c94f9741bb9 tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:33.072563 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5e364561-2464-4733-b8f2-2c94f9741bb9 tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:33.103510 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-5e364561-2464-4733-b8f2-2c94f9741bb9 tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] [instance: f86519e0-2abf-4492-b504-eb4177c1cac5] Going to try to terminate instance {{(pid=127198) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 16:33:33.197846 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-5e364561-2464-4733-b8f2-2c94f9741bb9 tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] 10.222.0.23 "DELETE /compute/v2.1/servers/f86519e0-2abf-4492-b504-eb4177c1cac5" status: 204 len: 0 microversion: 2.1 time: 0.140490 Sep 09 16:33:33.198471 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 136/273] 10.222.0.23 () {58 vars in 1239 bytes} [Fri Sep 9 16:33:33 2022] DELETE /compute/v2.1/servers/f86519e0-2abf-4492-b504-eb4177c1cac5 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 09 16:33:33.208564 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-172bae91-4ab5-47e7-b20b-57a9c50053fb tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:33:33.209900 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-172bae91-4ab5-47e7-b20b-57a9c50053fb tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] [instance: f86519e0-2abf-4492-b504-eb4177c1cac5] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:33:33.216570 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-172bae91-4ab5-47e7-b20b-57a9c50053fb tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:33.217132 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-172bae91-4ab5-47e7-b20b-57a9c50053fb tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:33.217749 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-172bae91-4ab5-47e7-b20b-57a9c50053fb tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:33.218417 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-172bae91-4ab5-47e7-b20b-57a9c50053fb tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:33.219013 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-172bae91-4ab5-47e7-b20b-57a9c50053fb tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:33.219499 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-172bae91-4ab5-47e7-b20b-57a9c50053fb tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:33.246439 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:33:33.461068 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-aadbbdc6-1cdc-4d4d-b788-85228ebe2d62 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d86f09c6304121be2021cb5c15e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ab544d0b547919794e3efb49ba0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:33:33.469866 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-aadbbdc6-1cdc-4d4d-b788-85228ebe2d62 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940" status: 200 len: 1522 microversion: 2.1 time: 0.456566 Sep 09 16:33:33.470819 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 138/274] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:33:33 2022] GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940 => generated 1522 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:33:33.475861 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [req-53b8e01c-f56b-48a0-9e8d-7f24f84df67d req-a18daa64-e3f5-462a-bb0a-2616b0627be9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90c05260-2024-4606-925b-8e63442113f7", "name": "network-vif-deleted", "tag": "0df0e967-b65d-4297-9c81-63241dbcb10e"}]} {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:33:33.485584 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [req-53b8e01c-f56b-48a0-9e8d-7f24f84df67d req-a18daa64-e3f5-462a-bb0a-2616b0627be9 service nova] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:33.486383 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [req-53b8e01c-f56b-48a0-9e8d-7f24f84df67d req-a18daa64-e3f5-462a-bb0a-2616b0627be9 service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:33.487044 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [req-53b8e01c-f56b-48a0-9e8d-7f24f84df67d req-a18daa64-e3f5-462a-bb0a-2616b0627be9 service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:33.502962 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.compute.server_external_events [req-53b8e01c-f56b-48a0-9e8d-7f24f84df67d req-a18daa64-e3f5-462a-bb0a-2616b0627be9 service nova] Creating event network-vif-deleted:0df0e967-b65d-4297-9c81-63241dbcb10e for instance 90c05260-2024-4606-925b-8e63442113f7 on hv-cinder-83124 Sep 09 16:33:33.508677 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [req-53b8e01c-f56b-48a0-9e8d-7f24f84df67d req-a18daa64-e3f5-462a-bb0a-2616b0627be9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036327 Sep 09 16:33:33.509576 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 139/275] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Sep 9 16:33:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:33:33.536066 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-172bae91-4ab5-47e7-b20b-57a9c50053fb tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e16e344f43f4fb8bf89e5fa9cd4a338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7bd597164874d2ca0c716694156cc03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:33:33.556528 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-172bae91-4ab5-47e7-b20b-57a9c50053fb tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] 10.222.0.23 "GET /compute/v2.1/servers/f86519e0-2abf-4492-b504-eb4177c1cac5" status: 200 len: 1471 microversion: 2.1 time: 0.353317 Sep 09 16:33:33.558398 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 137/276] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:33:33 2022] GET /compute/v2.1/servers/f86519e0-2abf-4492-b504-eb4177c1cac5 => generated 1471 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 16:33:33.697907 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-4c9c3552-5b20-4267-ab03-c035abf83b59 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-552810770", "imageRef": "0b1ba34f-2223-497a-9a18-c2ad8d398aae", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "da9ecde3-ba10-4e48-a429-5d8e9112473b"}], "security_groups": [{"name": "tempest-securitygroup--918054017"}], "key_name": "tempest-keypair-1808603169", "user_data": "}} {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:33:33.957296 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.network.neutron [None req-4c9c3552-5b20-4267-ab03-c035abf83b59 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] validate_networks() for [('da9ecde3-ba10-4e48-a429-5d8e9112473b', None, None, None, None, None)] {{(pid=127196) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 16:33:34.040092 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-f3ae8af1-48b0-4494-9293-bc8d0f0cd92a tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:33:34.041684 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-f3ae8af1-48b0-4494-9293-bc8d0f0cd92a tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] [instance: 90c05260-2024-4606-925b-8e63442113f7] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:33:34.048859 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f3ae8af1-48b0-4494-9293-bc8d0f0cd92a tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:34.049591 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f3ae8af1-48b0-4494-9293-bc8d0f0cd92a tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:34.050166 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f3ae8af1-48b0-4494-9293-bc8d0f0cd92a tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:34.051055 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f3ae8af1-48b0-4494-9293-bc8d0f0cd92a tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:34.051542 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f3ae8af1-48b0-4494-9293-bc8d0f0cd92a tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:34.052136 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f3ae8af1-48b0-4494-9293-bc8d0f0cd92a tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:34.131061 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-f3ae8af1-48b0-4494-9293-bc8d0f0cd92a tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2fbc3668cf4a82b8eea0b67b87ca80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9243cdc25d5444d847db4f59c05fa6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:33:34.139651 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-f3ae8af1-48b0-4494-9293-bc8d0f0cd92a tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] 10.222.0.23 "GET /compute/v2.1/servers/90c05260-2024-4606-925b-8e63442113f7" status: 200 len: 1462 microversion: 2.1 time: 0.105698 Sep 09 16:33:34.140461 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 138/277] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:33:34 2022] GET /compute/v2.1/servers/90c05260-2024-4606-925b-8e63442113f7 => generated 1462 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:33:34.370415 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.virt.hardware [None req-4c9c3552-5b20-4267-ab03-c035abf83b59 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Flavor limits 0:0:0 {{(pid=127196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 16:33:34.370864 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.virt.hardware [None req-4c9c3552-5b20-4267-ab03-c035abf83b59 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Image limits 0:0:0 {{(pid=127196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 16:33:34.371363 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.virt.hardware [None req-4c9c3552-5b20-4267-ab03-c035abf83b59 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Flavor pref 0:0:0 {{(pid=127196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 16:33:34.371787 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.virt.hardware [None req-4c9c3552-5b20-4267-ab03-c035abf83b59 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Image pref 0:0:0 {{(pid=127196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 16:33:34.372173 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.virt.hardware [None req-4c9c3552-5b20-4267-ab03-c035abf83b59 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 16:33:34.381338 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-4c9c3552-5b20-4267-ab03-c035abf83b59 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:34.381784 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-4c9c3552-5b20-4267-ab03-c035abf83b59 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:34.382207 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-4c9c3552-5b20-4267-ab03-c035abf83b59 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:34.383126 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-4c9c3552-5b20-4267-ab03-c035abf83b59 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:34.383662 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-4c9c3552-5b20-4267-ab03-c035abf83b59 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:34.384106 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-4c9c3552-5b20-4267-ab03-c035abf83b59 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:34.402437 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.quota [None req-4c9c3552-5b20-4267-ab03-c035abf83b59 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Getting quotas for project 3fca9208950f4d1a92bd52b4e5f5b2a1. Resources: {'cores', 'instances', 'ram'} {{(pid=127196) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 16:33:34.407178 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.quota [None req-4c9c3552-5b20-4267-ab03-c035abf83b59 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Getting quotas for user f8bd900e231242c3ae67432d26d089da and project 3fca9208950f4d1a92bd52b4e5f5b2a1. Resources: {'cores', 'instances', 'ram'} {{(pid=127196) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 16:33:34.429272 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-4c9c3552-5b20-4267-ab03-c035abf83b59 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Going to run 1 instances... {{(pid=127196) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 16:33:34.432598 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-4c9c3552-5b20-4267-ab03-c035abf83b59 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: 27b503a6-c023-49fb-b11a-37da810939cf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0b1ba34f-2223-497a-9a18-c2ad8d398aae',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127196) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 16:33:34.496700 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-0f0c5138-4883-42af-a188-44d09c1494f1 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:33:34.499545 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-0f0c5138-4883-42af-a188-44d09c1494f1 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: e8d23cb3-2f39-4b00-ae9d-006e392a5940] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:33:34.500415 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-4c9c3552-5b20-4267-ab03-c035abf83b59 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.807374 Sep 09 16:33:34.501074 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 140/278] 10.222.0.23 () {62 vars in 1188 bytes} [Fri Sep 9 16:33:33 2022] POST /compute/v2.1/servers => generated 401 bytes in 809 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 09 16:33:34.513858 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0f0c5138-4883-42af-a188-44d09c1494f1 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:34.514778 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-adb5d360-b76e-43b7-a2e1-793d943ebfda tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:33:34.515386 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0f0c5138-4883-42af-a188-44d09c1494f1 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:34.515516 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-adb5d360-b76e-43b7-a2e1-793d943ebfda tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: 27b503a6-c023-49fb-b11a-37da810939cf] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:33:34.516965 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0f0c5138-4883-42af-a188-44d09c1494f1 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:34.517938 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0f0c5138-4883-42af-a188-44d09c1494f1 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:34.518621 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0f0c5138-4883-42af-a188-44d09c1494f1 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:34.519499 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0f0c5138-4883-42af-a188-44d09c1494f1 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:34.661873 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-adb5d360-b76e-43b7-a2e1-793d943ebfda tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:33:34.676239 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-adb5d360-b76e-43b7-a2e1-793d943ebfda tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:33:34.687607 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-adb5d360-b76e-43b7-a2e1-793d943ebfda tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:33:34.688810 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-adb5d360-b76e-43b7-a2e1-793d943ebfda tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf" status: 200 len: 1281 microversion: 2.20 time: 0.178712 Sep 09 16:33:34.717479 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 141/279] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Sep 9 16:33:34 2022] GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf => generated 1281 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 16:33:34.730580 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-617a043b-56bd-42e1-86f0-208d1ee94944 tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:33:34.731272 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-617a043b-56bd-42e1-86f0-208d1ee94944 tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] [instance: f86519e0-2abf-4492-b504-eb4177c1cac5] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:33:34.737727 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-617a043b-56bd-42e1-86f0-208d1ee94944 tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:34.738203 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-617a043b-56bd-42e1-86f0-208d1ee94944 tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:34.738847 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-617a043b-56bd-42e1-86f0-208d1ee94944 tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:34.739803 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-617a043b-56bd-42e1-86f0-208d1ee94944 tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:34.740587 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-617a043b-56bd-42e1-86f0-208d1ee94944 tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:34.741230 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-617a043b-56bd-42e1-86f0-208d1ee94944 tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:34.777119 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-0f0c5138-4883-42af-a188-44d09c1494f1 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d86f09c6304121be2021cb5c15e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ab544d0b547919794e3efb49ba0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:33:34.788040 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-0f0c5138-4883-42af-a188-44d09c1494f1 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940" status: 200 len: 1522 microversion: 2.1 time: 0.298040 Sep 09 16:33:34.788632 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 139/280] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:33:34 2022] GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940 => generated 1522 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 16:33:35.040213 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-617a043b-56bd-42e1-86f0-208d1ee94944 tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e16e344f43f4fb8bf89e5fa9cd4a338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7bd597164874d2ca0c716694156cc03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:33:35.049276 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-617a043b-56bd-42e1-86f0-208d1ee94944 tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] 10.222.0.23 "GET /compute/v2.1/servers/f86519e0-2abf-4492-b504-eb4177c1cac5" status: 200 len: 1471 microversion: 2.1 time: 0.330125 Sep 09 16:33:35.049866 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 142/281] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:33:34 2022] GET /compute/v2.1/servers/f86519e0-2abf-4492-b504-eb4177c1cac5 => generated 1471 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:33:35.163534 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-e3afb46c-12dc-4ef9-9c69-8455f6341130 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:33:35.164199 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-e3afb46c-12dc-4ef9-9c69-8455f6341130 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] [instance: 90c05260-2024-4606-925b-8e63442113f7] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:33:35.171590 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e3afb46c-12dc-4ef9-9c69-8455f6341130 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:35.172501 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e3afb46c-12dc-4ef9-9c69-8455f6341130 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:35.172979 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e3afb46c-12dc-4ef9-9c69-8455f6341130 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:35.173675 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e3afb46c-12dc-4ef9-9c69-8455f6341130 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:35.174116 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e3afb46c-12dc-4ef9-9c69-8455f6341130 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:35.174593 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e3afb46c-12dc-4ef9-9c69-8455f6341130 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:35.210059 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e3afb46c-12dc-4ef9-9c69-8455f6341130 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:35.210679 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e3afb46c-12dc-4ef9-9c69-8455f6341130 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:35.211804 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e3afb46c-12dc-4ef9-9c69-8455f6341130 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:35.212281 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.objects.instance [None req-e3afb46c-12dc-4ef9-9c69-8455f6341130 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lazy-loading 'fault' on Instance uuid 90c05260-2024-4606-925b-8e63442113f7 {{(pid=127198) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 16:33:35.273360 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-e3afb46c-12dc-4ef9-9c69-8455f6341130 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2fbc3668cf4a82b8eea0b67b87ca80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9243cdc25d5444d847db4f59c05fa6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:33:35.285702 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-e3afb46c-12dc-4ef9-9c69-8455f6341130 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] 10.222.0.23 "GET /compute/v2.1/servers/90c05260-2024-4606-925b-8e63442113f7" status: 200 len: 1303 microversion: 2.1 time: 0.125823 Sep 09 16:33:35.286338 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 140/282] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:33:35 2022] GET /compute/v2.1/servers/90c05260-2024-4606-925b-8e63442113f7 => generated 1303 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:33:35.529905 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [req-b471219e-8ae2-4a95-ab61-ccb6d5a31e6e req-9fd10fcc-be70-4df4-b741-dafb9f5cc677 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f86519e0-2abf-4492-b504-eb4177c1cac5", "name": "network-vif-deleted", "tag": "b99ef884-0920-460f-90c3-8c391d9ac7b7"}]} {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:33:35.542751 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [req-b471219e-8ae2-4a95-ab61-ccb6d5a31e6e req-9fd10fcc-be70-4df4-b741-dafb9f5cc677 service nova] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:35.543221 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [req-b471219e-8ae2-4a95-ab61-ccb6d5a31e6e req-9fd10fcc-be70-4df4-b741-dafb9f5cc677 service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:35.543839 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [req-b471219e-8ae2-4a95-ab61-ccb6d5a31e6e req-9fd10fcc-be70-4df4-b741-dafb9f5cc677 service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:35.555475 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.compute.server_external_events [req-b471219e-8ae2-4a95-ab61-ccb6d5a31e6e req-9fd10fcc-be70-4df4-b741-dafb9f5cc677 service nova] Creating event network-vif-deleted:b99ef884-0920-460f-90c3-8c391d9ac7b7 for instance f86519e0-2abf-4492-b504-eb4177c1cac5 on hv-cinder-83124 Sep 09 16:33:35.561555 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [req-b471219e-8ae2-4a95-ab61-ccb6d5a31e6e req-9fd10fcc-be70-4df4-b741-dafb9f5cc677 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035520 Sep 09 16:33:35.562770 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 143/283] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Sep 9 16:33:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:33:35.717863 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-64ff2fae-ad84-4c68-9776-899ac20c337f tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:33:35.718488 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-64ff2fae-ad84-4c68-9776-899ac20c337f tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: 27b503a6-c023-49fb-b11a-37da810939cf] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:33:35.724577 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-64ff2fae-ad84-4c68-9776-899ac20c337f tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:35.725057 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-64ff2fae-ad84-4c68-9776-899ac20c337f tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:35.725479 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-64ff2fae-ad84-4c68-9776-899ac20c337f tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:35.726160 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-64ff2fae-ad84-4c68-9776-899ac20c337f tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:35.726662 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-64ff2fae-ad84-4c68-9776-899ac20c337f tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:35.727100 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-64ff2fae-ad84-4c68-9776-899ac20c337f tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:35.789356 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-64ff2fae-ad84-4c68-9776-899ac20c337f tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:33:35.798469 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-64ff2fae-ad84-4c68-9776-899ac20c337f tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:33:35.799524 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-64ff2fae-ad84-4c68-9776-899ac20c337f tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:33:35.800638 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-64ff2fae-ad84-4c68-9776-899ac20c337f tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf" status: 200 len: 1333 microversion: 2.20 time: 0.087009 Sep 09 16:33:35.801186 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 141/284] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Sep 9 16:33:35 2022] GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf => generated 1333 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 16:33:35.820759 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-fd96a6e7-6d36-4a42-b54b-c4826b2a67ac tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:33:35.821464 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-fd96a6e7-6d36-4a42-b54b-c4826b2a67ac tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: e8d23cb3-2f39-4b00-ae9d-006e392a5940] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:33:35.828073 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-fd96a6e7-6d36-4a42-b54b-c4826b2a67ac tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:35.828775 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-fd96a6e7-6d36-4a42-b54b-c4826b2a67ac tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:35.829360 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-fd96a6e7-6d36-4a42-b54b-c4826b2a67ac tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:35.830064 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-fd96a6e7-6d36-4a42-b54b-c4826b2a67ac tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:35.830738 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-fd96a6e7-6d36-4a42-b54b-c4826b2a67ac tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:35.832486 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-fd96a6e7-6d36-4a42-b54b-c4826b2a67ac tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:35.965590 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-fd96a6e7-6d36-4a42-b54b-c4826b2a67ac tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d86f09c6304121be2021cb5c15e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ab544d0b547919794e3efb49ba0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:33:35.973793 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-fd96a6e7-6d36-4a42-b54b-c4826b2a67ac tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940" status: 200 len: 1522 microversion: 2.1 time: 0.157583 Sep 09 16:33:35.974362 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 144/285] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:33:35 2022] GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:33:36.073017 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-149b1bc6-5a5f-4153-8b7f-3613ad0ee308 tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:33:36.073832 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-149b1bc6-5a5f-4153-8b7f-3613ad0ee308 tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] [instance: f86519e0-2abf-4492-b504-eb4177c1cac5] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:33:36.083155 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-149b1bc6-5a5f-4153-8b7f-3613ad0ee308 tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:36.083608 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-149b1bc6-5a5f-4153-8b7f-3613ad0ee308 tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:36.084230 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-149b1bc6-5a5f-4153-8b7f-3613ad0ee308 tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:36.084994 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-149b1bc6-5a5f-4153-8b7f-3613ad0ee308 tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:36.085463 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-149b1bc6-5a5f-4153-8b7f-3613ad0ee308 tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:36.085878 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-149b1bc6-5a5f-4153-8b7f-3613ad0ee308 tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:36.121581 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-149b1bc6-5a5f-4153-8b7f-3613ad0ee308 tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:36.122065 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-149b1bc6-5a5f-4153-8b7f-3613ad0ee308 tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:36.122524 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-149b1bc6-5a5f-4153-8b7f-3613ad0ee308 tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:36.122979 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.objects.instance [None req-149b1bc6-5a5f-4153-8b7f-3613ad0ee308 tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Lazy-loading 'fault' on Instance uuid f86519e0-2abf-4492-b504-eb4177c1cac5 {{(pid=127198) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 16:33:36.198284 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-149b1bc6-5a5f-4153-8b7f-3613ad0ee308 tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e16e344f43f4fb8bf89e5fa9cd4a338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7bd597164874d2ca0c716694156cc03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:33:36.211599 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-149b1bc6-5a5f-4153-8b7f-3613ad0ee308 tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] 10.222.0.23 "GET /compute/v2.1/servers/f86519e0-2abf-4492-b504-eb4177c1cac5" status: 200 len: 1305 microversion: 2.1 time: 0.142861 Sep 09 16:33:36.213202 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 142/286] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:33:36 2022] GET /compute/v2.1/servers/f86519e0-2abf-4492-b504-eb4177c1cac5 => generated 1305 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:33:36.310386 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-2c8d8f73-176a-4232-b85c-1300096b0499 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:33:36.311288 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-2c8d8f73-176a-4232-b85c-1300096b0499 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] [instance: 90c05260-2024-4606-925b-8e63442113f7] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:33:36.317751 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-2c8d8f73-176a-4232-b85c-1300096b0499 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:36.318372 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-2c8d8f73-176a-4232-b85c-1300096b0499 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:36.319022 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-2c8d8f73-176a-4232-b85c-1300096b0499 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:36.319704 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-2c8d8f73-176a-4232-b85c-1300096b0499 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:36.320153 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-2c8d8f73-176a-4232-b85c-1300096b0499 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:36.320566 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-2c8d8f73-176a-4232-b85c-1300096b0499 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:36.334881 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.wsgi [None req-2c8d8f73-176a-4232-b85c-1300096b0499 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] HTTP exception thrown: Instance 90c05260-2024-4606-925b-8e63442113f7 could not be found. Sep 09 16:33:36.336533 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-2c8d8f73-176a-4232-b85c-1300096b0499 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Request method failure captured: Sep 09 16:33:36.336533 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: request: GET /compute/v2.1/servers/90c05260-2024-4606-925b-8e63442113f7 HTTP/1.1 Sep 09 16:33:36.336533 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Accept: application/json Sep 09 16:33:36.336533 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Accept-Encoding: identity Sep 09 16:33:36.336533 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Connection: close Sep 09 16:33:36.336533 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Content-Length: 0 Sep 09 16:33:36.336533 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Content-Type: application/json Sep 09 16:33:36.336533 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Host: 10.222.0.23 Sep 09 16:33:36.336533 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Openstack-System-Scope: None Sep 09 16:33:36.336533 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: User-Agent: python-urllib3/1.26.12 Sep 09 16:33:36.336533 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Auth-Token: gAAAAABjG2quCI1CB7FZV25aWt7ARzWFfv3ewE7rqNAmU85Cn5FC_h6qJndbbEJ-jeRCkn-X516xQ3MQD_hHlluiQGu90eWibbTx9j5V3Wpakx2AjGOIXwa1DIkdWMP4MtLRxAfNxHtP14QZSdiuhu96eSIp-oXw7u2n3NShF0fuTAJDuPC19j4 Sep 09 16:33:36.336533 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Domain-Id: None Sep 09 16:33:36.336533 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Domain-Name: None Sep 09 16:33:36.336533 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Identity-Status: Confirmed Sep 09 16:33:36.336533 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Is-Admin-Project: True Sep 09 16:33:36.336533 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Project-Domain-Id: default Sep 09 16:33:36.336533 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Project-Domain-Name: Default Sep 09 16:33:36.336533 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Project-Id: e9243cdc25d5444d847db4f59c05fa6a Sep 09 16:33:36.336533 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Project-Name: tempest-VolumesActionsTest-769230162 Sep 09 16:33:36.336533 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Role: member,reader Sep 09 16:33:36.336533 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Roles: member,reader Sep 09 16:33:36.337851 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e9243cdc25d5444d847db4f59c05fa6a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e9243cdc25d5444d847db4f59c05fa6a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e9243cdc25d5444d847db4f59c05fa6a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e9243cdc25d5444d847db4f59c05fa6a"}]}] Sep 09 16:33:36.337851 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Tenant: tempest-VolumesActionsTest-769230162 Sep 09 16:33:36.337851 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Tenant-Id: e9243cdc25d5444d847db4f59c05fa6a Sep 09 16:33:36.337851 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Tenant-Name: tempest-VolumesActionsTest-769230162 Sep 09 16:33:36.337851 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-User: tempest-VolumesActionsTest-769230162-project Sep 09 16:33:36.337851 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-User-Domain-Id: default Sep 09 16:33:36.337851 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-User-Domain-Name: Default Sep 09 16:33:36.337851 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-User-Id: 6d2fbc3668cf4a82b8eea0b67b87ca80 Sep 09 16:33:36.337851 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-User-Name: tempest-VolumesActionsTest-769230162-project Sep 09 16:33:36.337851 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: method: > Sep 09 16:33:36.337851 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: exception: Instance 90c05260-2024-4606-925b-8e63442113f7 could not be found. Sep 09 16:33:36.337851 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: action_args: {'id': '90c05260-2024-4606-925b-8e63442113f7'} Sep 09 16:33:36.338698 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 16:33:36.338698 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:33:36.338698 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 16:33:36.338698 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 16:33:36.338698 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 16:33:36.338698 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 16:33:36.338698 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 16:33:36.338698 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 16:33:36.338698 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 16:33:36.338698 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 16:33:36.338698 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90c05260-2024-4606-925b-8e63442113f7 could not be found. Sep 09 16:33:36.338698 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Sep 09 16:33:36.338698 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 16:33:36.338698 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Sep 09 16:33:36.338698 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:33:36.338698 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 16:33:36.338698 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 16:33:36.338698 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 16:33:36.338698 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 16:33:36.338698 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 16:33:36.339809 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 16:33:36.339809 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 16:33:36.339809 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 16:33:36.339809 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 16:33:36.339809 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 16:33:36.339809 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 16:33:36.339809 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 16:33:36.339809 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90c05260-2024-4606-925b-8e63442113f7 could not be found. Sep 09 16:33:36.339809 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Sep 09 16:33:36.339809 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 16:33:36.339809 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Sep 09 16:33:36.339809 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:33:36.339809 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 16:33:36.339809 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 16:33:36.339809 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 16:33:36.339809 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 16:33:36.339809 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90c05260-2024-4606-925b-8e63442113f7 could not be found. Sep 09 16:33:36.339809 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Sep 09 16:33:36.340784 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-2c8d8f73-176a-4232-b85c-1300096b0499 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] Returning 404 to user: Instance 90c05260-2024-4606-925b-8e63442113f7 could not be found. {{(pid=127196) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 16:33:36.340784 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-2c8d8f73-176a-4232-b85c-1300096b0499 tempest-VolumesActionsTest-769230162 tempest-VolumesActionsTest-769230162-project] 10.222.0.23 "GET /compute/v2.1/servers/90c05260-2024-4606-925b-8e63442113f7" status: 404 len: 111 microversion: 2.1 time: 0.031681 Sep 09 16:33:36.340784 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 145/287] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:33:36 2022] GET /compute/v2.1/servers/90c05260-2024-4606-925b-8e63442113f7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 16:33:36.827135 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-33890c71-367c-4551-bec8-aa0d6cb05263 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:33:36.827737 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-33890c71-367c-4551-bec8-aa0d6cb05263 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: 27b503a6-c023-49fb-b11a-37da810939cf] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:33:36.833795 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-33890c71-367c-4551-bec8-aa0d6cb05263 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:36.834294 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-33890c71-367c-4551-bec8-aa0d6cb05263 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:36.834737 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-33890c71-367c-4551-bec8-aa0d6cb05263 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:36.835428 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-33890c71-367c-4551-bec8-aa0d6cb05263 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:36.835872 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-33890c71-367c-4551-bec8-aa0d6cb05263 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:36.836287 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-33890c71-367c-4551-bec8-aa0d6cb05263 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:36.899953 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-33890c71-367c-4551-bec8-aa0d6cb05263 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:33:36.908217 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-33890c71-367c-4551-bec8-aa0d6cb05263 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:33:36.909676 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-33890c71-367c-4551-bec8-aa0d6cb05263 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:33:36.910879 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-33890c71-367c-4551-bec8-aa0d6cb05263 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf" status: 200 len: 1339 microversion: 2.20 time: 0.087755 Sep 09 16:33:36.911435 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 143/288] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Sep 9 16:33:36 2022] GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf => generated 1339 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 16:33:36.997496 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-9cd06fad-9584-45d5-9aa8-e34df453ce32 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:33:36.998101 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-9cd06fad-9584-45d5-9aa8-e34df453ce32 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: e8d23cb3-2f39-4b00-ae9d-006e392a5940] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:33:37.004810 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-9cd06fad-9584-45d5-9aa8-e34df453ce32 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:37.005298 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-9cd06fad-9584-45d5-9aa8-e34df453ce32 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:37.005727 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-9cd06fad-9584-45d5-9aa8-e34df453ce32 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:37.006412 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-9cd06fad-9584-45d5-9aa8-e34df453ce32 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:37.006903 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-9cd06fad-9584-45d5-9aa8-e34df453ce32 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:37.007310 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-9cd06fad-9584-45d5-9aa8-e34df453ce32 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:37.176254 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-9cd06fad-9584-45d5-9aa8-e34df453ce32 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d86f09c6304121be2021cb5c15e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ab544d0b547919794e3efb49ba0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:33:37.185318 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-9cd06fad-9584-45d5-9aa8-e34df453ce32 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940" status: 200 len: 1522 microversion: 2.1 time: 0.192108 Sep 09 16:33:37.186623 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 146/289] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:33:36 2022] GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940 => generated 1522 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:33:37.235940 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-bf371afc-1376-4f4e-8e79-f7e9e300c561 tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:33:37.236582 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-bf371afc-1376-4f4e-8e79-f7e9e300c561 tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] [instance: f86519e0-2abf-4492-b504-eb4177c1cac5] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:33:37.243266 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-bf371afc-1376-4f4e-8e79-f7e9e300c561 tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:37.243736 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-bf371afc-1376-4f4e-8e79-f7e9e300c561 tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:37.244160 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-bf371afc-1376-4f4e-8e79-f7e9e300c561 tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:37.244850 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-bf371afc-1376-4f4e-8e79-f7e9e300c561 tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:37.245298 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-bf371afc-1376-4f4e-8e79-f7e9e300c561 tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:37.245716 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-bf371afc-1376-4f4e-8e79-f7e9e300c561 tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:37.276548 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-bf371afc-1376-4f4e-8e79-f7e9e300c561 tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:37.277023 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-bf371afc-1376-4f4e-8e79-f7e9e300c561 tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:37.277453 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-bf371afc-1376-4f4e-8e79-f7e9e300c561 tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:37.277891 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.objects.instance [None req-bf371afc-1376-4f4e-8e79-f7e9e300c561 tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Lazy-loading 'fault' on Instance uuid f86519e0-2abf-4492-b504-eb4177c1cac5 {{(pid=127198) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 16:33:37.330276 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-bf371afc-1376-4f4e-8e79-f7e9e300c561 tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e16e344f43f4fb8bf89e5fa9cd4a338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7bd597164874d2ca0c716694156cc03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:33:37.339729 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-bf371afc-1376-4f4e-8e79-f7e9e300c561 tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] 10.222.0.23 "GET /compute/v2.1/servers/f86519e0-2abf-4492-b504-eb4177c1cac5" status: 200 len: 1305 microversion: 2.1 time: 0.107685 Sep 09 16:33:37.340308 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 144/290] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:33:37 2022] GET /compute/v2.1/servers/f86519e0-2abf-4492-b504-eb4177c1cac5 => generated 1305 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:33:37.936487 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-dc34008b-b143-4398-88e1-f8e18d9a1d3c tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:33:37.937087 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-dc34008b-b143-4398-88e1-f8e18d9a1d3c tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: 27b503a6-c023-49fb-b11a-37da810939cf] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:33:37.943622 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-dc34008b-b143-4398-88e1-f8e18d9a1d3c tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:37.944082 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-dc34008b-b143-4398-88e1-f8e18d9a1d3c tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:37.944689 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-dc34008b-b143-4398-88e1-f8e18d9a1d3c tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:37.945376 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-dc34008b-b143-4398-88e1-f8e18d9a1d3c tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:37.945820 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-dc34008b-b143-4398-88e1-f8e18d9a1d3c tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:37.946232 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-dc34008b-b143-4398-88e1-f8e18d9a1d3c tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:38.085998 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-dc34008b-b143-4398-88e1-f8e18d9a1d3c tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:33:38.098108 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-dc34008b-b143-4398-88e1-f8e18d9a1d3c tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:33:38.099793 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-dc34008b-b143-4398-88e1-f8e18d9a1d3c tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:33:38.100908 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-dc34008b-b143-4398-88e1-f8e18d9a1d3c tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf" status: 200 len: 1406 microversion: 2.20 time: 0.168507 Sep 09 16:33:38.101462 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 147/291] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Sep 9 16:33:37 2022] GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf => generated 1406 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 16:33:38.209397 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-b04af926-8696-421f-809b-fcf06f31722e tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:33:38.210007 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-b04af926-8696-421f-809b-fcf06f31722e tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: e8d23cb3-2f39-4b00-ae9d-006e392a5940] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:33:38.216339 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b04af926-8696-421f-809b-fcf06f31722e tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:38.216822 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b04af926-8696-421f-809b-fcf06f31722e tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:38.217254 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b04af926-8696-421f-809b-fcf06f31722e tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:38.217953 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b04af926-8696-421f-809b-fcf06f31722e tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:38.218409 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b04af926-8696-421f-809b-fcf06f31722e tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:38.218939 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b04af926-8696-421f-809b-fcf06f31722e tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:38.354163 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-b04af926-8696-421f-809b-fcf06f31722e tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d86f09c6304121be2021cb5c15e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ab544d0b547919794e3efb49ba0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:33:38.362810 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-b04af926-8696-421f-809b-fcf06f31722e tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940" status: 200 len: 1522 microversion: 2.1 time: 0.157286 Sep 09 16:33:38.363359 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 145/292] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:33:38 2022] GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:33:38.366316 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-c6bcb712-b004-41d5-9bfd-5a2e0bd9dbb7 tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:33:38.366979 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-c6bcb712-b004-41d5-9bfd-5a2e0bd9dbb7 tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] [instance: f86519e0-2abf-4492-b504-eb4177c1cac5] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:33:38.373526 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-c6bcb712-b004-41d5-9bfd-5a2e0bd9dbb7 tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:38.374001 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-c6bcb712-b004-41d5-9bfd-5a2e0bd9dbb7 tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:38.374402 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-c6bcb712-b004-41d5-9bfd-5a2e0bd9dbb7 tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:38.375169 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-c6bcb712-b004-41d5-9bfd-5a2e0bd9dbb7 tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:38.375613 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-c6bcb712-b004-41d5-9bfd-5a2e0bd9dbb7 tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:38.376028 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-c6bcb712-b004-41d5-9bfd-5a2e0bd9dbb7 tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:38.404015 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG dbcounter [-] [127196] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=127196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:33:38.407885 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-c6bcb712-b004-41d5-9bfd-5a2e0bd9dbb7 tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:38.408358 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-c6bcb712-b004-41d5-9bfd-5a2e0bd9dbb7 tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:38.408758 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-c6bcb712-b004-41d5-9bfd-5a2e0bd9dbb7 tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:38.409224 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.objects.instance [None req-c6bcb712-b004-41d5-9bfd-5a2e0bd9dbb7 tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Lazy-loading 'fault' on Instance uuid f86519e0-2abf-4492-b504-eb4177c1cac5 {{(pid=127196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 16:33:38.457947 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-c6bcb712-b004-41d5-9bfd-5a2e0bd9dbb7 tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e16e344f43f4fb8bf89e5fa9cd4a338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7bd597164874d2ca0c716694156cc03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:33:38.466366 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-c6bcb712-b004-41d5-9bfd-5a2e0bd9dbb7 tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] 10.222.0.23 "GET /compute/v2.1/servers/f86519e0-2abf-4492-b504-eb4177c1cac5" status: 200 len: 1305 microversion: 2.1 time: 0.103972 Sep 09 16:33:38.466972 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 148/293] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:33:38 2022] GET /compute/v2.1/servers/f86519e0-2abf-4492-b504-eb4177c1cac5 => generated 1305 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:33:39.127973 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-b4b1fcd5-fbd0-4579-b1e2-29259cdc9986 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:33:39.128826 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-b4b1fcd5-fbd0-4579-b1e2-29259cdc9986 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: 27b503a6-c023-49fb-b11a-37da810939cf] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:33:39.138936 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b4b1fcd5-fbd0-4579-b1e2-29259cdc9986 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:39.139613 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b4b1fcd5-fbd0-4579-b1e2-29259cdc9986 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:39.140175 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b4b1fcd5-fbd0-4579-b1e2-29259cdc9986 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:39.141078 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b4b1fcd5-fbd0-4579-b1e2-29259cdc9986 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:39.141672 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b4b1fcd5-fbd0-4579-b1e2-29259cdc9986 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:39.142231 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b4b1fcd5-fbd0-4579-b1e2-29259cdc9986 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:39.273683 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-b4b1fcd5-fbd0-4579-b1e2-29259cdc9986 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:33:39.286432 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-b4b1fcd5-fbd0-4579-b1e2-29259cdc9986 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:33:39.288678 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-b4b1fcd5-fbd0-4579-b1e2-29259cdc9986 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:33:39.290335 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-b4b1fcd5-fbd0-4579-b1e2-29259cdc9986 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf" status: 200 len: 1406 microversion: 2.20 time: 0.167501 Sep 09 16:33:39.291125 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 146/294] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Sep 9 16:33:39 2022] GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf => generated 1406 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 16:33:39.389989 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-e1d64068-3b4b-404d-85b0-f449fb43cf7d tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:33:39.391051 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-e1d64068-3b4b-404d-85b0-f449fb43cf7d tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: e8d23cb3-2f39-4b00-ae9d-006e392a5940] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:33:39.399062 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e1d64068-3b4b-404d-85b0-f449fb43cf7d tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:39.399543 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e1d64068-3b4b-404d-85b0-f449fb43cf7d tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:39.399971 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e1d64068-3b4b-404d-85b0-f449fb43cf7d tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:39.400657 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e1d64068-3b4b-404d-85b0-f449fb43cf7d tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:39.401110 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e1d64068-3b4b-404d-85b0-f449fb43cf7d tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:39.401541 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e1d64068-3b4b-404d-85b0-f449fb43cf7d tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:39.489275 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-a6a17f09-c8d0-47e7-95b2-e96470173b92 tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:33:39.489955 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-a6a17f09-c8d0-47e7-95b2-e96470173b92 tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] [instance: f86519e0-2abf-4492-b504-eb4177c1cac5] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:33:39.496312 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a6a17f09-c8d0-47e7-95b2-e96470173b92 tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:39.496874 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a6a17f09-c8d0-47e7-95b2-e96470173b92 tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:39.497309 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a6a17f09-c8d0-47e7-95b2-e96470173b92 tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:39.497991 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a6a17f09-c8d0-47e7-95b2-e96470173b92 tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:39.498439 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a6a17f09-c8d0-47e7-95b2-e96470173b92 tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:39.498888 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a6a17f09-c8d0-47e7-95b2-e96470173b92 tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:39.531685 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-e1d64068-3b4b-404d-85b0-f449fb43cf7d tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d86f09c6304121be2021cb5c15e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ab544d0b547919794e3efb49ba0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:33:39.532437 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a6a17f09-c8d0-47e7-95b2-e96470173b92 tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:39.532926 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a6a17f09-c8d0-47e7-95b2-e96470173b92 tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:39.533356 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a6a17f09-c8d0-47e7-95b2-e96470173b92 tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:39.533803 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.objects.instance [None req-a6a17f09-c8d0-47e7-95b2-e96470173b92 tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Lazy-loading 'fault' on Instance uuid f86519e0-2abf-4492-b504-eb4177c1cac5 {{(pid=127198) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 16:33:39.539640 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-e1d64068-3b4b-404d-85b0-f449fb43cf7d tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940" status: 200 len: 1522 microversion: 2.1 time: 0.156898 Sep 09 16:33:39.540429 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 149/295] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:33:39 2022] GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:33:39.576943 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-a6a17f09-c8d0-47e7-95b2-e96470173b92 tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e16e344f43f4fb8bf89e5fa9cd4a338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7bd597164874d2ca0c716694156cc03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:33:39.584780 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-a6a17f09-c8d0-47e7-95b2-e96470173b92 tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] 10.222.0.23 "GET /compute/v2.1/servers/f86519e0-2abf-4492-b504-eb4177c1cac5" status: 200 len: 1305 microversion: 2.1 time: 0.099377 Sep 09 16:33:39.585347 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 147/296] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:33:39 2022] GET /compute/v2.1/servers/f86519e0-2abf-4492-b504-eb4177c1cac5 => generated 1305 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 16:33:40.318953 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-787d305b-e552-4439-b038-c0c98854c17d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:33:40.319563 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-787d305b-e552-4439-b038-c0c98854c17d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: 27b503a6-c023-49fb-b11a-37da810939cf] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:33:40.326181 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-787d305b-e552-4439-b038-c0c98854c17d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:40.326672 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-787d305b-e552-4439-b038-c0c98854c17d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:40.327335 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-787d305b-e552-4439-b038-c0c98854c17d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:40.328033 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-787d305b-e552-4439-b038-c0c98854c17d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:40.328468 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-787d305b-e552-4439-b038-c0c98854c17d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:40.328890 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-787d305b-e552-4439-b038-c0c98854c17d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:40.535617 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-787d305b-e552-4439-b038-c0c98854c17d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:33:40.544400 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-787d305b-e552-4439-b038-c0c98854c17d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:33:40.545846 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-787d305b-e552-4439-b038-c0c98854c17d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:33:40.547592 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-787d305b-e552-4439-b038-c0c98854c17d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf" status: 200 len: 1406 microversion: 2.20 time: 0.232435 Sep 09 16:33:40.548164 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 150/297] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Sep 9 16:33:40 2022] GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf => generated 1406 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 16:33:40.570407 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-b6d29c9f-72c5-45b0-b6c8-6e9010186632 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:33:40.571193 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-b6d29c9f-72c5-45b0-b6c8-6e9010186632 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: e8d23cb3-2f39-4b00-ae9d-006e392a5940] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:33:40.577732 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b6d29c9f-72c5-45b0-b6c8-6e9010186632 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:40.578291 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b6d29c9f-72c5-45b0-b6c8-6e9010186632 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:40.578818 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b6d29c9f-72c5-45b0-b6c8-6e9010186632 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:40.579607 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b6d29c9f-72c5-45b0-b6c8-6e9010186632 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:40.580117 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b6d29c9f-72c5-45b0-b6c8-6e9010186632 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:40.580603 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b6d29c9f-72c5-45b0-b6c8-6e9010186632 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:40.608969 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-836c3062-370a-457c-b412-a644942e108d tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:33:40.609585 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-836c3062-370a-457c-b412-a644942e108d tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] [instance: f86519e0-2abf-4492-b504-eb4177c1cac5] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:33:40.616088 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-836c3062-370a-457c-b412-a644942e108d tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:40.616646 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-836c3062-370a-457c-b412-a644942e108d tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:40.617158 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-836c3062-370a-457c-b412-a644942e108d tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:40.617860 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-836c3062-370a-457c-b412-a644942e108d tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:40.618315 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-836c3062-370a-457c-b412-a644942e108d tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:40.618768 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-836c3062-370a-457c-b412-a644942e108d tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:40.632890 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.wsgi [None req-836c3062-370a-457c-b412-a644942e108d tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] HTTP exception thrown: Instance f86519e0-2abf-4492-b504-eb4177c1cac5 could not be found. Sep 09 16:33:40.634543 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-836c3062-370a-457c-b412-a644942e108d tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Request method failure captured: Sep 09 16:33:40.634543 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: request: GET /compute/v2.1/servers/f86519e0-2abf-4492-b504-eb4177c1cac5 HTTP/1.1 Sep 09 16:33:40.634543 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Accept: application/json Sep 09 16:33:40.634543 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Accept-Encoding: identity Sep 09 16:33:40.634543 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Connection: close Sep 09 16:33:40.634543 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Content-Length: 0 Sep 09 16:33:40.634543 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Content-Type: application/json Sep 09 16:33:40.634543 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Host: 10.222.0.23 Sep 09 16:33:40.634543 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Openstack-System-Scope: None Sep 09 16:33:40.634543 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: User-Agent: python-urllib3/1.26.12 Sep 09 16:33:40.634543 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Auth-Token: gAAAAABjG2rMQTLlD6rTG5ZFeScFQddK0Gekhd0rVU8IfKsEhBzZ1-G8UxN-XYsFkaoVVFLtosHJGkyeoAPaewCdEZQ65jEeBdNe7FjyzeVIQu8wdOP-s9oLM6qsrfmpytHpsbtLHj7AxWWJ6mrjbocxdx60gEyBnSHicE28V1xPce4kQRs9J7k Sep 09 16:33:40.634543 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Domain-Id: None Sep 09 16:33:40.634543 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Domain-Name: None Sep 09 16:33:40.634543 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Identity-Status: Confirmed Sep 09 16:33:40.634543 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Is-Admin-Project: True Sep 09 16:33:40.634543 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Project-Domain-Id: default Sep 09 16:33:40.634543 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Project-Domain-Name: Default Sep 09 16:33:40.634543 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Project-Id: a7bd597164874d2ca0c716694156cc03 Sep 09 16:33:40.634543 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Project-Name: tempest-VolumesNegativeTest-1990252750 Sep 09 16:33:40.634543 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Role: member,reader Sep 09 16:33:40.634543 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Roles: member,reader Sep 09 16:33:40.636014 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a7bd597164874d2ca0c716694156cc03"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a7bd597164874d2ca0c716694156cc03"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a7bd597164874d2ca0c716694156cc03"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a7bd597164874d2ca0c716694156cc03"}]}] Sep 09 16:33:40.636014 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Tenant: tempest-VolumesNegativeTest-1990252750 Sep 09 16:33:40.636014 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Tenant-Id: a7bd597164874d2ca0c716694156cc03 Sep 09 16:33:40.636014 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Tenant-Name: tempest-VolumesNegativeTest-1990252750 Sep 09 16:33:40.636014 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-User: tempest-VolumesNegativeTest-1990252750-project Sep 09 16:33:40.636014 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-User-Domain-Id: default Sep 09 16:33:40.636014 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-User-Domain-Name: Default Sep 09 16:33:40.636014 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-User-Id: 0e16e344f43f4fb8bf89e5fa9cd4a338 Sep 09 16:33:40.636014 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-User-Name: tempest-VolumesNegativeTest-1990252750-project Sep 09 16:33:40.636014 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: method: > Sep 09 16:33:40.636014 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: exception: Instance f86519e0-2abf-4492-b504-eb4177c1cac5 could not be found. Sep 09 16:33:40.636014 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: action_args: {'id': 'f86519e0-2abf-4492-b504-eb4177c1cac5'} Sep 09 16:33:40.636812 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 16:33:40.636812 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:33:40.636812 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 16:33:40.636812 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 16:33:40.636812 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 16:33:40.636812 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 16:33:40.636812 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 16:33:40.636812 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 16:33:40.636812 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 16:33:40.636812 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 16:33:40.636812 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f86519e0-2abf-4492-b504-eb4177c1cac5 could not be found. Sep 09 16:33:40.636812 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Sep 09 16:33:40.636812 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 16:33:40.636812 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Sep 09 16:33:40.636812 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:33:40.636812 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 16:33:40.636812 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 16:33:40.636812 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 16:33:40.636812 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 16:33:40.636812 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 16:33:40.638090 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 16:33:40.638090 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 16:33:40.638090 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 16:33:40.638090 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 16:33:40.638090 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 16:33:40.638090 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 16:33:40.638090 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 16:33:40.638090 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f86519e0-2abf-4492-b504-eb4177c1cac5 could not be found. Sep 09 16:33:40.638090 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Sep 09 16:33:40.638090 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 16:33:40.638090 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Sep 09 16:33:40.638090 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:33:40.638090 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 16:33:40.638090 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 16:33:40.638090 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 16:33:40.638090 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 16:33:40.638090 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f86519e0-2abf-4492-b504-eb4177c1cac5 could not be found. Sep 09 16:33:40.638090 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Sep 09 16:33:40.639874 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-836c3062-370a-457c-b412-a644942e108d tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] Returning 404 to user: Instance f86519e0-2abf-4492-b504-eb4177c1cac5 could not be found. {{(pid=127196) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 16:33:40.640721 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-836c3062-370a-457c-b412-a644942e108d tempest-VolumesNegativeTest-1990252750 tempest-VolumesNegativeTest-1990252750-project] 10.222.0.23 "GET /compute/v2.1/servers/f86519e0-2abf-4492-b504-eb4177c1cac5" status: 404 len: 111 microversion: 2.1 time: 0.035866 Sep 09 16:33:40.641271 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 151/298] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:33:40 2022] GET /compute/v2.1/servers/f86519e0-2abf-4492-b504-eb4177c1cac5 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 16:33:40.821036 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-b6d29c9f-72c5-45b0-b6c8-6e9010186632 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d86f09c6304121be2021cb5c15e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ab544d0b547919794e3efb49ba0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:33:40.829214 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-b6d29c9f-72c5-45b0-b6c8-6e9010186632 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940" status: 200 len: 1522 microversion: 2.1 time: 0.269689 Sep 09 16:33:40.830325 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 148/299] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:33:40 2022] GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940 => generated 1522 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:33:40.980556 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [req-83177637-20da-4251-8672-df4a1d16c113 req-39d27b74-ee16-42a5-9d32-70337e186b12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27b503a6-c023-49fb-b11a-37da810939cf", "tag": "56079a62-4748-409c-b913-eb3925499a09"}]} {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:33:40.991499 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [req-83177637-20da-4251-8672-df4a1d16c113 req-39d27b74-ee16-42a5-9d32-70337e186b12 service nova] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:40.991976 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [req-83177637-20da-4251-8672-df4a1d16c113 req-39d27b74-ee16-42a5-9d32-70337e186b12 service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:40.992384 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [req-83177637-20da-4251-8672-df4a1d16c113 req-39d27b74-ee16-42a5-9d32-70337e186b12 service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:41.005018 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.compute.server_external_events [req-83177637-20da-4251-8672-df4a1d16c113 req-39d27b74-ee16-42a5-9d32-70337e186b12 service nova] Creating event network-changed:56079a62-4748-409c-b913-eb3925499a09 for instance 27b503a6-c023-49fb-b11a-37da810939cf on hv-cinder-83124 Sep 09 16:33:41.010985 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [req-83177637-20da-4251-8672-df4a1d16c113 req-39d27b74-ee16-42a5-9d32-70337e186b12 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035557 Sep 09 16:33:41.011573 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 152/300] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Sep 9 16:33:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:33:41.574482 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-71b40581-5ce9-442b-bd49-8ad33ee58652 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:33:41.575753 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-71b40581-5ce9-442b-bd49-8ad33ee58652 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: 27b503a6-c023-49fb-b11a-37da810939cf] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:33:41.585985 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-71b40581-5ce9-442b-bd49-8ad33ee58652 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:41.586998 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-71b40581-5ce9-442b-bd49-8ad33ee58652 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:41.587889 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-71b40581-5ce9-442b-bd49-8ad33ee58652 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:41.589226 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-71b40581-5ce9-442b-bd49-8ad33ee58652 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:41.590118 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-71b40581-5ce9-442b-bd49-8ad33ee58652 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:41.590792 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-71b40581-5ce9-442b-bd49-8ad33ee58652 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:41.768198 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-71b40581-5ce9-442b-bd49-8ad33ee58652 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:33:41.778523 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-71b40581-5ce9-442b-bd49-8ad33ee58652 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:33:41.780807 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-71b40581-5ce9-442b-bd49-8ad33ee58652 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:33:41.782446 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-71b40581-5ce9-442b-bd49-8ad33ee58652 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf" status: 200 len: 1406 microversion: 2.20 time: 0.212469 Sep 09 16:33:41.783676 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 149/301] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Sep 9 16:33:41 2022] GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf => generated 1406 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 16:33:41.854439 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-6805b26b-d984-4c6d-9a32-29d5e2659a96 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:33:41.855861 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-6805b26b-d984-4c6d-9a32-29d5e2659a96 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: e8d23cb3-2f39-4b00-ae9d-006e392a5940] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:33:41.863918 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-6805b26b-d984-4c6d-9a32-29d5e2659a96 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:41.864599 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-6805b26b-d984-4c6d-9a32-29d5e2659a96 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:41.865337 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-6805b26b-d984-4c6d-9a32-29d5e2659a96 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:41.866224 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-6805b26b-d984-4c6d-9a32-29d5e2659a96 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:41.866895 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-6805b26b-d984-4c6d-9a32-29d5e2659a96 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:41.867460 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-6805b26b-d984-4c6d-9a32-29d5e2659a96 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:42.055462 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-e57ae3f5-213d-4643-8221-30b0fa8bdb55 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:33:42.056320 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-e57ae3f5-213d-4643-8221-30b0fa8bdb55 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] [instance: c453c474-644e-4e46-9d23-b2b87716f5d7] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:33:42.064436 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e57ae3f5-213d-4643-8221-30b0fa8bdb55 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:42.064936 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e57ae3f5-213d-4643-8221-30b0fa8bdb55 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:42.065412 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e57ae3f5-213d-4643-8221-30b0fa8bdb55 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:42.066315 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e57ae3f5-213d-4643-8221-30b0fa8bdb55 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:42.066786 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e57ae3f5-213d-4643-8221-30b0fa8bdb55 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:42.067245 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e57ae3f5-213d-4643-8221-30b0fa8bdb55 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:42.124893 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-e57ae3f5-213d-4643-8221-30b0fa8bdb55 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] 10.222.0.23 "GET /compute/v2.1/servers/c453c474-644e-4e46-9d23-b2b87716f5d7/ips" status: 200 len: 150 microversion: 2.1 time: 0.074854 Sep 09 16:33:42.125829 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 150/302] 10.222.0.23 () {58 vars in 1248 bytes} [Fri Sep 9 16:33:42 2022] GET /compute/v2.1/servers/c453c474-644e-4e46-9d23-b2b87716f5d7/ips => generated 150 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:33:42.240985 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-6805b26b-d984-4c6d-9a32-29d5e2659a96 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d86f09c6304121be2021cb5c15e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ab544d0b547919794e3efb49ba0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:33:42.253861 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-6805b26b-d984-4c6d-9a32-29d5e2659a96 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940" status: 200 len: 1522 microversion: 2.1 time: 0.403852 Sep 09 16:33:42.255554 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 153/303] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:33:41 2022] GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940 => generated 1522 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:33:42.821146 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-c54c6806-69aa-412d-ad57-2071c3a9f3fb tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:33:42.823043 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-c54c6806-69aa-412d-ad57-2071c3a9f3fb tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: 27b503a6-c023-49fb-b11a-37da810939cf] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:33:42.844987 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c54c6806-69aa-412d-ad57-2071c3a9f3fb tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:42.846151 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c54c6806-69aa-412d-ad57-2071c3a9f3fb tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:42.846885 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c54c6806-69aa-412d-ad57-2071c3a9f3fb tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:42.848952 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c54c6806-69aa-412d-ad57-2071c3a9f3fb tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:42.850626 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c54c6806-69aa-412d-ad57-2071c3a9f3fb tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:42.851235 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c54c6806-69aa-412d-ad57-2071c3a9f3fb tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:43.050184 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-c54c6806-69aa-412d-ad57-2071c3a9f3fb tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:33:43.071313 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-c54c6806-69aa-412d-ad57-2071c3a9f3fb tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:33:43.080004 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-c54c6806-69aa-412d-ad57-2071c3a9f3fb tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:33:43.081315 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-c54c6806-69aa-412d-ad57-2071c3a9f3fb tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf" status: 200 len: 1406 microversion: 2.20 time: 0.273097 Sep 09 16:33:43.099047 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 151/304] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Sep 9 16:33:42 2022] GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf => generated 1406 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 16:33:43.278560 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-2d3e175c-e0d6-408c-a04a-f5507efb3247 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:33:43.279583 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-2d3e175c-e0d6-408c-a04a-f5507efb3247 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: e8d23cb3-2f39-4b00-ae9d-006e392a5940] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:33:43.286272 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-2d3e175c-e0d6-408c-a04a-f5507efb3247 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:43.286928 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-2d3e175c-e0d6-408c-a04a-f5507efb3247 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:43.287618 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-2d3e175c-e0d6-408c-a04a-f5507efb3247 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:43.288602 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-2d3e175c-e0d6-408c-a04a-f5507efb3247 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:43.289660 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-2d3e175c-e0d6-408c-a04a-f5507efb3247 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:43.290341 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-2d3e175c-e0d6-408c-a04a-f5507efb3247 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:43.523215 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-2d3e175c-e0d6-408c-a04a-f5507efb3247 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d86f09c6304121be2021cb5c15e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ab544d0b547919794e3efb49ba0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:33:43.532374 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-2d3e175c-e0d6-408c-a04a-f5507efb3247 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940" status: 200 len: 1502 microversion: 2.1 time: 0.257861 Sep 09 16:33:43.538881 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 154/305] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:33:43 2022] GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940 => generated 1502 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:33:43.564917 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-ceff8977-f7f8-43d9-8daa-ed431a6930fc tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:33:43.565717 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-ceff8977-f7f8-43d9-8daa-ed431a6930fc tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: cc41312a-3de8-4584-9bcf-a1f31b952025] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:33:43.574167 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ceff8977-f7f8-43d9-8daa-ed431a6930fc tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:43.574837 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ceff8977-f7f8-43d9-8daa-ed431a6930fc tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:43.575272 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ceff8977-f7f8-43d9-8daa-ed431a6930fc tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:43.575964 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ceff8977-f7f8-43d9-8daa-ed431a6930fc tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:43.583793 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ceff8977-f7f8-43d9-8daa-ed431a6930fc tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:43.584675 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ceff8977-f7f8-43d9-8daa-ed431a6930fc tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:43.645154 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-392d4bba-839e-4be4-b075-007b01d51ce0 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ed9a13bd-a45c-4452-9cc0-f8ef353c3cee"}} {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:33:43.647885 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-392d4bba-839e-4be4-b075-007b01d51ce0 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] [instance: c453c474-644e-4e46-9d23-b2b87716f5d7] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:33:43.655209 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-392d4bba-839e-4be4-b075-007b01d51ce0 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:43.658883 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-392d4bba-839e-4be4-b075-007b01d51ce0 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:43.659606 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-392d4bba-839e-4be4-b075-007b01d51ce0 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:43.670188 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-392d4bba-839e-4be4-b075-007b01d51ce0 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:43.670765 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-392d4bba-839e-4be4-b075-007b01d51ce0 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:43.671360 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-392d4bba-839e-4be4-b075-007b01d51ce0 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:43.960589 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-ceff8977-f7f8-43d9-8daa-ed431a6930fc tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d86f09c6304121be2021cb5c15e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ab544d0b547919794e3efb49ba0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:33:43.972998 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-ceff8977-f7f8-43d9-8daa-ed431a6930fc tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/cc41312a-3de8-4584-9bcf-a1f31b952025" status: 200 len: 1516 microversion: 2.1 time: 0.411832 Sep 09 16:33:43.986907 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 152/306] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:33:43 2022] GET /compute/v2.1/servers/cc41312a-3de8-4584-9bcf-a1f31b952025 => generated 1516 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:33:44.106189 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-f54fe967-7e29-4409-8fc4-c667d1115272 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:33:44.106858 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-f54fe967-7e29-4409-8fc4-c667d1115272 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: 27b503a6-c023-49fb-b11a-37da810939cf] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:33:44.119972 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f54fe967-7e29-4409-8fc4-c667d1115272 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:44.120462 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f54fe967-7e29-4409-8fc4-c667d1115272 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:44.121079 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f54fe967-7e29-4409-8fc4-c667d1115272 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:44.121947 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f54fe967-7e29-4409-8fc4-c667d1115272 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:44.122573 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f54fe967-7e29-4409-8fc4-c667d1115272 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:44.123142 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f54fe967-7e29-4409-8fc4-c667d1115272 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:44.127699 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell1:SELECT=100 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:33:44.144661 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-392d4bba-839e-4be4-b075-007b01d51ce0 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] 10.222.0.23 "POST /compute/v2.1/servers/c453c474-644e-4e46-9d23-b2b87716f5d7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.503114 Sep 09 16:33:44.148027 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 155/307] 10.222.0.23 () {60 vars in 1323 bytes} [Fri Sep 9 16:33:43 2022] POST /compute/v2.1/servers/c453c474-644e-4e46-9d23-b2b87716f5d7/os-volume_attachments => generated 194 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 16:33:44.534435 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-f54fe967-7e29-4409-8fc4-c667d1115272 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:33:44.548375 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-f54fe967-7e29-4409-8fc4-c667d1115272 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:33:44.550231 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-f54fe967-7e29-4409-8fc4-c667d1115272 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:33:44.551706 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-f54fe967-7e29-4409-8fc4-c667d1115272 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf" status: 200 len: 1406 microversion: 2.20 time: 0.449322 Sep 09 16:33:44.553204 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 153/308] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Sep 9 16:33:44 2022] GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf => generated 1406 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 16:33:45.579185 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG dbcounter [-] [127196] Writing DB stats nova_cell0:SELECT=2 {{(pid=127196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:33:45.579864 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG dbcounter [-] [127196] Writing DB stats nova_cell0:SELECT=12 {{(pid=127196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:33:45.584898 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-3f56bfbf-0aa7-420b-93e2-c9dd78775fb8 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:33:45.585585 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-3f56bfbf-0aa7-420b-93e2-c9dd78775fb8 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: 27b503a6-c023-49fb-b11a-37da810939cf] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:33:45.593216 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-3f56bfbf-0aa7-420b-93e2-c9dd78775fb8 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:45.593697 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-3f56bfbf-0aa7-420b-93e2-c9dd78775fb8 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:45.594325 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-3f56bfbf-0aa7-420b-93e2-c9dd78775fb8 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:45.595078 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-3f56bfbf-0aa7-420b-93e2-c9dd78775fb8 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:45.595518 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-3f56bfbf-0aa7-420b-93e2-c9dd78775fb8 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:45.596081 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-3f56bfbf-0aa7-420b-93e2-c9dd78775fb8 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:45.794410 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-3f56bfbf-0aa7-420b-93e2-c9dd78775fb8 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:33:45.803020 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-c4e2dc72-5475-4076-ab2d-4f129ee80271 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:33:45.804105 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG dbcounter [-] [127196] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:33:45.808150 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-c4e2dc72-5475-4076-ab2d-4f129ee80271 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: cc41312a-3de8-4584-9bcf-a1f31b952025] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:33:45.816163 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-3f56bfbf-0aa7-420b-93e2-c9dd78775fb8 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:33:45.816732 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c4e2dc72-5475-4076-ab2d-4f129ee80271 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:45.817416 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c4e2dc72-5475-4076-ab2d-4f129ee80271 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:45.817961 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c4e2dc72-5475-4076-ab2d-4f129ee80271 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:45.818792 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c4e2dc72-5475-4076-ab2d-4f129ee80271 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:45.819346 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c4e2dc72-5475-4076-ab2d-4f129ee80271 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:45.820265 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c4e2dc72-5475-4076-ab2d-4f129ee80271 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:45.821510 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-3f56bfbf-0aa7-420b-93e2-c9dd78775fb8 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:33:45.823206 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-3f56bfbf-0aa7-420b-93e2-c9dd78775fb8 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf" status: 200 len: 1406 microversion: 2.20 time: 0.245701 Sep 09 16:33:45.824641 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 156/309] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Sep 9 16:33:45 2022] GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf => generated 1406 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 16:33:45.846718 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.objects.instance [None req-c4e2dc72-5475-4076-ab2d-4f129ee80271 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lazy-loading 'flavor' on Instance uuid cc41312a-3de8-4584-9bcf-a1f31b952025 {{(pid=127198) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 16:33:45.932330 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-c4e2dc72-5475-4076-ab2d-4f129ee80271 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "POST /compute/v2.1/servers/cc41312a-3de8-4584-9bcf-a1f31b952025/action" status: 200 len: 32 microversion: 2.1 time: 0.136138 Sep 09 16:33:45.933180 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 154/310] 10.222.0.23 () {60 vars in 1278 bytes} [Fri Sep 9 16:33:45 2022] POST /compute/v2.1/servers/cc41312a-3de8-4584-9bcf-a1f31b952025/action => generated 32 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 09 16:33:45.943183 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-156046b4-27bf-4597-a957-3f88b217a978 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:33:45.944093 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-156046b4-27bf-4597-a957-3f88b217a978 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: cc41312a-3de8-4584-9bcf-a1f31b952025] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:33:45.953596 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-156046b4-27bf-4597-a957-3f88b217a978 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:45.954314 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-156046b4-27bf-4597-a957-3f88b217a978 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:45.955164 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-156046b4-27bf-4597-a957-3f88b217a978 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:45.956115 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-156046b4-27bf-4597-a957-3f88b217a978 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:45.956875 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-156046b4-27bf-4597-a957-3f88b217a978 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:45.957768 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-156046b4-27bf-4597-a957-3f88b217a978 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:46.170792 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [req-adad2c61-9317-476d-a3dd-9049c7ab88c6 req-78f87321-2c5b-4a0a-89a6-caef8b638756 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27b503a6-c023-49fb-b11a-37da810939cf", "name": "network-vif-plugged", "status": "completed", "tag": "56079a62-4748-409c-b913-eb3925499a09"}]} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:33:46.189470 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-adad2c61-9317-476d-a3dd-9049c7ab88c6 req-78f87321-2c5b-4a0a-89a6-caef8b638756 service nova] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:46.190242 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-adad2c61-9317-476d-a3dd-9049c7ab88c6 req-78f87321-2c5b-4a0a-89a6-caef8b638756 service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:46.191997 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-adad2c61-9317-476d-a3dd-9049c7ab88c6 req-78f87321-2c5b-4a0a-89a6-caef8b638756 service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:46.212037 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.compute.server_external_events [req-adad2c61-9317-476d-a3dd-9049c7ab88c6 req-78f87321-2c5b-4a0a-89a6-caef8b638756 service nova] Creating event network-vif-plugged:56079a62-4748-409c-b913-eb3925499a09 for instance 27b503a6-c023-49fb-b11a-37da810939cf on hv-cinder-83124 Sep 09 16:33:46.219292 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [req-adad2c61-9317-476d-a3dd-9049c7ab88c6 req-78f87321-2c5b-4a0a-89a6-caef8b638756 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052548 Sep 09 16:33:46.220601 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 155/311] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Sep 9 16:33:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 16:33:46.243805 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-156046b4-27bf-4597-a957-3f88b217a978 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d86f09c6304121be2021cb5c15e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ab544d0b547919794e3efb49ba0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:33:46.261461 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-156046b4-27bf-4597-a957-3f88b217a978 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/cc41312a-3de8-4584-9bcf-a1f31b952025" status: 200 len: 1522 microversion: 2.1 time: 0.322282 Sep 09 16:33:46.269685 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 157/312] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:33:45 2022] GET /compute/v2.1/servers/cc41312a-3de8-4584-9bcf-a1f31b952025 => generated 1522 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 16:33:46.850699 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-fc8ca938-5dbd-4aa8-acdb-3a89046029e2 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:33:46.851423 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-fc8ca938-5dbd-4aa8-acdb-3a89046029e2 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: 27b503a6-c023-49fb-b11a-37da810939cf] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:33:46.869392 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fc8ca938-5dbd-4aa8-acdb-3a89046029e2 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:46.869911 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fc8ca938-5dbd-4aa8-acdb-3a89046029e2 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:46.870618 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fc8ca938-5dbd-4aa8-acdb-3a89046029e2 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:46.871592 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fc8ca938-5dbd-4aa8-acdb-3a89046029e2 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:46.872352 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fc8ca938-5dbd-4aa8-acdb-3a89046029e2 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:46.872960 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fc8ca938-5dbd-4aa8-acdb-3a89046029e2 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:47.090488 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-fc8ca938-5dbd-4aa8-acdb-3a89046029e2 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:33:47.101491 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-fc8ca938-5dbd-4aa8-acdb-3a89046029e2 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:33:47.105374 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-fc8ca938-5dbd-4aa8-acdb-3a89046029e2 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:33:47.107550 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-fc8ca938-5dbd-4aa8-acdb-3a89046029e2 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf" status: 200 len: 1406 microversion: 2.20 time: 0.262561 Sep 09 16:33:47.110224 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 156/313] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Sep 9 16:33:46 2022] GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf => generated 1406 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 16:33:47.299092 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-3ae5709e-3b81-44e4-9f7a-9a4b379092dc tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:33:47.300686 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-3ae5709e-3b81-44e4-9f7a-9a4b379092dc tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: cc41312a-3de8-4584-9bcf-a1f31b952025] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:33:47.316054 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-3ae5709e-3b81-44e4-9f7a-9a4b379092dc tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:47.317216 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-3ae5709e-3b81-44e4-9f7a-9a4b379092dc tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:47.318318 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-3ae5709e-3b81-44e4-9f7a-9a4b379092dc tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:47.319579 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-3ae5709e-3b81-44e4-9f7a-9a4b379092dc tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:47.320385 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-3ae5709e-3b81-44e4-9f7a-9a4b379092dc tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:47.321065 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-3ae5709e-3b81-44e4-9f7a-9a4b379092dc tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:47.518936 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-3ae5709e-3b81-44e4-9f7a-9a4b379092dc tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d86f09c6304121be2021cb5c15e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ab544d0b547919794e3efb49ba0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:33:47.527988 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-3ae5709e-3b81-44e4-9f7a-9a4b379092dc tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/cc41312a-3de8-4584-9bcf-a1f31b952025" status: 200 len: 1522 microversion: 2.1 time: 0.238534 Sep 09 16:33:47.529089 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 158/314] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:33:47 2022] GET /compute/v2.1/servers/cc41312a-3de8-4584-9bcf-a1f31b952025 => generated 1522 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:33:48.135424 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-59d04133-ea63-444c-bd7d-fff48f6b9bd5 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:33:48.136126 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-59d04133-ea63-444c-bd7d-fff48f6b9bd5 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: 27b503a6-c023-49fb-b11a-37da810939cf] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:33:48.143223 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-59d04133-ea63-444c-bd7d-fff48f6b9bd5 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:48.143720 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-59d04133-ea63-444c-bd7d-fff48f6b9bd5 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:48.144155 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-59d04133-ea63-444c-bd7d-fff48f6b9bd5 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:48.144960 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-59d04133-ea63-444c-bd7d-fff48f6b9bd5 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:48.145419 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-59d04133-ea63-444c-bd7d-fff48f6b9bd5 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:48.145841 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-59d04133-ea63-444c-bd7d-fff48f6b9bd5 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:48.318086 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-59d04133-ea63-444c-bd7d-fff48f6b9bd5 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:33:48.326647 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-59d04133-ea63-444c-bd7d-fff48f6b9bd5 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:33:48.328034 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-59d04133-ea63-444c-bd7d-fff48f6b9bd5 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:33:48.329170 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-59d04133-ea63-444c-bd7d-fff48f6b9bd5 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf" status: 200 len: 1598 microversion: 2.20 time: 0.197876 Sep 09 16:33:48.329728 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 157/315] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Sep 9 16:33:48 2022] GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf => generated 1598 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 16:33:48.354268 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-91ed76d0-9d51-4db9-8e77-ec031a611b04 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:33:48.355432 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-91ed76d0-9d51-4db9-8e77-ec031a611b04 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: 27b503a6-c023-49fb-b11a-37da810939cf] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:33:48.361148 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-91ed76d0-9d51-4db9-8e77-ec031a611b04 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:48.361622 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-91ed76d0-9d51-4db9-8e77-ec031a611b04 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:48.362048 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-91ed76d0-9d51-4db9-8e77-ec031a611b04 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:48.362761 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-91ed76d0-9d51-4db9-8e77-ec031a611b04 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:48.363197 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-91ed76d0-9d51-4db9-8e77-ec031a611b04 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:48.363686 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-91ed76d0-9d51-4db9-8e77-ec031a611b04 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:48.447399 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-91ed76d0-9d51-4db9-8e77-ec031a611b04 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.096969 Sep 09 16:33:48.448467 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 159/316] 10.222.0.23 () {60 vars in 1316 bytes} [Fri Sep 9 16:33:48 2022] GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 16:33:48.553922 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-252efeed-3ed9-4912-81d5-38d22cc20ed0 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:33:48.555061 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-252efeed-3ed9-4912-81d5-38d22cc20ed0 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: cc41312a-3de8-4584-9bcf-a1f31b952025] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:33:48.563980 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-252efeed-3ed9-4912-81d5-38d22cc20ed0 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:48.565440 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-252efeed-3ed9-4912-81d5-38d22cc20ed0 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:48.566103 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-252efeed-3ed9-4912-81d5-38d22cc20ed0 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:48.567081 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-252efeed-3ed9-4912-81d5-38d22cc20ed0 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:48.567840 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-252efeed-3ed9-4912-81d5-38d22cc20ed0 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:48.568435 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-252efeed-3ed9-4912-81d5-38d22cc20ed0 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:48.741738 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-252efeed-3ed9-4912-81d5-38d22cc20ed0 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d86f09c6304121be2021cb5c15e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ab544d0b547919794e3efb49ba0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:33:48.751150 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-252efeed-3ed9-4912-81d5-38d22cc20ed0 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/cc41312a-3de8-4584-9bcf-a1f31b952025" status: 200 len: 1522 microversion: 2.1 time: 0.201701 Sep 09 16:33:48.763946 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 158/317] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:33:48 2022] GET /compute/v2.1/servers/cc41312a-3de8-4584-9bcf-a1f31b952025 => generated 1522 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:33:49.728648 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [req-d8ef6d3d-0520-43e3-94da-d9834aad8464 req-49828dbc-5da1-4e72-99a6-554420fdf717 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27b503a6-c023-49fb-b11a-37da810939cf", "tag": "56079a62-4748-409c-b913-eb3925499a09"}]} {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:33:49.753456 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [req-d8ef6d3d-0520-43e3-94da-d9834aad8464 req-49828dbc-5da1-4e72-99a6-554420fdf717 service nova] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:49.754282 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [req-d8ef6d3d-0520-43e3-94da-d9834aad8464 req-49828dbc-5da1-4e72-99a6-554420fdf717 service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:49.754903 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [req-d8ef6d3d-0520-43e3-94da-d9834aad8464 req-49828dbc-5da1-4e72-99a6-554420fdf717 service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:49.766872 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.compute.server_external_events [req-d8ef6d3d-0520-43e3-94da-d9834aad8464 req-49828dbc-5da1-4e72-99a6-554420fdf717 service nova] Creating event network-changed:56079a62-4748-409c-b913-eb3925499a09 for instance 27b503a6-c023-49fb-b11a-37da810939cf on hv-cinder-83124 Sep 09 16:33:49.774097 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [req-d8ef6d3d-0520-43e3-94da-d9834aad8464 req-49828dbc-5da1-4e72-99a6-554420fdf717 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053675 Sep 09 16:33:49.774966 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 160/318] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Sep 9 16:33:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:33:49.779186 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-293f13ec-6717-40cf-b929-eb790b3d5208 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:33:49.779800 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-293f13ec-6717-40cf-b929-eb790b3d5208 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: cc41312a-3de8-4584-9bcf-a1f31b952025] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:33:49.787201 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-293f13ec-6717-40cf-b929-eb790b3d5208 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:49.787979 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-293f13ec-6717-40cf-b929-eb790b3d5208 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:49.788745 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-293f13ec-6717-40cf-b929-eb790b3d5208 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:49.789676 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-293f13ec-6717-40cf-b929-eb790b3d5208 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:49.792489 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-293f13ec-6717-40cf-b929-eb790b3d5208 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:49.792489 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-293f13ec-6717-40cf-b929-eb790b3d5208 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:49.993921 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-293f13ec-6717-40cf-b929-eb790b3d5208 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d86f09c6304121be2021cb5c15e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ab544d0b547919794e3efb49ba0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:33:50.002623 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-293f13ec-6717-40cf-b929-eb790b3d5208 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/cc41312a-3de8-4584-9bcf-a1f31b952025" status: 200 len: 1522 microversion: 2.1 time: 0.230107 Sep 09 16:33:50.003211 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 159/319] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:33:49 2022] GET /compute/v2.1/servers/cc41312a-3de8-4584-9bcf-a1f31b952025 => generated 1522 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:33:50.885117 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-dba5dfce-5b42-4b8f-98ff-1595051c9556 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:33:50.885693 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-dba5dfce-5b42-4b8f-98ff-1595051c9556 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] [instance: 9e761961-9c74-444c-bb4b-0b2f82a9d698] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:33:50.894522 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-dba5dfce-5b42-4b8f-98ff-1595051c9556 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:50.896228 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-dba5dfce-5b42-4b8f-98ff-1595051c9556 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:50.896877 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-dba5dfce-5b42-4b8f-98ff-1595051c9556 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:50.897789 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-dba5dfce-5b42-4b8f-98ff-1595051c9556 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:50.898450 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-dba5dfce-5b42-4b8f-98ff-1595051c9556 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:50.899096 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-dba5dfce-5b42-4b8f-98ff-1595051c9556 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:50.927335 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-dba5dfce-5b42-4b8f-98ff-1595051c9556 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] 10.222.0.23 "GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698/ips" status: 200 len: 145 microversion: 2.1 time: 0.046802 Sep 09 16:33:50.935725 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 161/320] 10.222.0.23 () {58 vars in 1248 bytes} [Fri Sep 9 16:33:50 2022] GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698/ips => generated 145 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 16:33:51.026208 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-f1e8ee9c-bb20-482c-9f5e-fb1b6320ab61 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:33:51.027188 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-f1e8ee9c-bb20-482c-9f5e-fb1b6320ab61 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: cc41312a-3de8-4584-9bcf-a1f31b952025] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:33:51.033472 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:33:51.035553 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f1e8ee9c-bb20-482c-9f5e-fb1b6320ab61 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:51.036291 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f1e8ee9c-bb20-482c-9f5e-fb1b6320ab61 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:51.037469 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f1e8ee9c-bb20-482c-9f5e-fb1b6320ab61 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:51.038390 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f1e8ee9c-bb20-482c-9f5e-fb1b6320ab61 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:51.039062 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f1e8ee9c-bb20-482c-9f5e-fb1b6320ab61 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:51.039675 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f1e8ee9c-bb20-482c-9f5e-fb1b6320ab61 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:51.276791 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-f1e8ee9c-bb20-482c-9f5e-fb1b6320ab61 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d86f09c6304121be2021cb5c15e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ab544d0b547919794e3efb49ba0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:33:51.289001 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-f1e8ee9c-bb20-482c-9f5e-fb1b6320ab61 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/cc41312a-3de8-4584-9bcf-a1f31b952025" status: 200 len: 1522 microversion: 2.1 time: 0.267346 Sep 09 16:33:51.289595 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 160/321] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:33:51 2022] GET /compute/v2.1/servers/cc41312a-3de8-4584-9bcf-a1f31b952025 => generated 1522 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 16:33:51.937722 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-be3ac2d9-cdc4-4678-895f-3d8b128a5444 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Action: 'create', calling method: .version_select at 0x7f24fb7763a0>, body: {"keypair": {"name": "tempest-keypair-1800361580", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBLW902PxvGheTWd+PSgiqiKZz5nEtoLUExYvDK8UVQmmhAlw7otBf7G96XxrhQuON4/vq/ZcSIzDWnRS22K0QY7Lw1VTLUtIyfdD3WCjzoYSAKoj5glLhNBYFPCIhARzw=="}} {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:33:51.955029 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.quota [None req-be3ac2d9-cdc4-4678-895f-3d8b128a5444 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Getting quotas for project e17967a941be4a04bbc180e2cf3a7a55. Resources: {'key_pairs'} {{(pid=127196) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 16:33:51.959714 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.quota [None req-be3ac2d9-cdc4-4678-895f-3d8b128a5444 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Getting quotas for user 53c0721dc18343b18993ff5af098841d and project e17967a941be4a04bbc180e2cf3a7a55. Resources: {'key_pairs'} {{(pid=127196) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 16:33:51.987617 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-be3ac2d9-cdc4-4678-895f-3d8b128a5444 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.053833 Sep 09 16:33:51.994941 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 162/322] 10.222.0.23 () {60 vars in 1159 bytes} [Fri Sep 9 16:33:51 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:33:52.312762 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-4ea81375-c516-486a-b0b5-09d5fe15ca5f tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:33:52.314059 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-4ea81375-c516-486a-b0b5-09d5fe15ca5f tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: cc41312a-3de8-4584-9bcf-a1f31b952025] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:33:52.324498 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4ea81375-c516-486a-b0b5-09d5fe15ca5f tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:52.325226 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4ea81375-c516-486a-b0b5-09d5fe15ca5f tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:52.325956 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4ea81375-c516-486a-b0b5-09d5fe15ca5f tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:52.329832 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4ea81375-c516-486a-b0b5-09d5fe15ca5f tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:52.329832 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4ea81375-c516-486a-b0b5-09d5fe15ca5f tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:52.329832 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4ea81375-c516-486a-b0b5-09d5fe15ca5f tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:52.841213 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-4ea81375-c516-486a-b0b5-09d5fe15ca5f tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d86f09c6304121be2021cb5c15e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ab544d0b547919794e3efb49ba0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:33:52.852393 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-4ea81375-c516-486a-b0b5-09d5fe15ca5f tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/cc41312a-3de8-4584-9bcf-a1f31b952025" status: 200 len: 1522 microversion: 2.1 time: 0.543369 Sep 09 16:33:52.853473 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 161/323] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:33:52 2022] GET /compute/v2.1/servers/cc41312a-3de8-4584-9bcf-a1f31b952025 => generated 1522 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 16:33:53.880889 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-389fd3dd-d6b1-445a-8b0e-248eafb9716a tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:33:53.881701 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-389fd3dd-d6b1-445a-8b0e-248eafb9716a tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: cc41312a-3de8-4584-9bcf-a1f31b952025] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:33:53.892059 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-389fd3dd-d6b1-445a-8b0e-248eafb9716a tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:53.893013 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-389fd3dd-d6b1-445a-8b0e-248eafb9716a tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:53.893013 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-389fd3dd-d6b1-445a-8b0e-248eafb9716a tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:53.893680 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-389fd3dd-d6b1-445a-8b0e-248eafb9716a tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:53.894105 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-389fd3dd-d6b1-445a-8b0e-248eafb9716a tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:53.894567 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-389fd3dd-d6b1-445a-8b0e-248eafb9716a tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:54.060005 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-389fd3dd-d6b1-445a-8b0e-248eafb9716a tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d86f09c6304121be2021cb5c15e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ab544d0b547919794e3efb49ba0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:33:54.068289 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-389fd3dd-d6b1-445a-8b0e-248eafb9716a tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/cc41312a-3de8-4584-9bcf-a1f31b952025" status: 200 len: 1522 microversion: 2.1 time: 0.191940 Sep 09 16:33:54.075765 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 163/324] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:33:53 2022] GET /compute/v2.1/servers/cc41312a-3de8-4584-9bcf-a1f31b952025 => generated 1522 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:33:54.227677 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-e53fb6c2-4a1b-494e-abc2-d904b7dc9573 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1493396343", "imageRef": "0b1ba34f-2223-497a-9a18-c2ad8d398aae", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5831de5e-0ff3-4415-b956-35183f0be5e2"}], "security_groups": [{"name": "tempest-securitygroup--556858232"}], "key_name": "tempest-keypair-1800361580", "user_data": "}} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:33:54.387098 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-02ddce50-6fc5-4428-bc3c-b96791ab7c4b tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2a73b452-5d0e-4987-a8c6-ebaa0f9add01"}} {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:33:54.390067 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-02ddce50-6fc5-4428-bc3c-b96791ab7c4b tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] [instance: 9e761961-9c74-444c-bb4b-0b2f82a9d698] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:33:54.398251 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-02ddce50-6fc5-4428-bc3c-b96791ab7c4b tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:54.398487 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-02ddce50-6fc5-4428-bc3c-b96791ab7c4b tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:54.398945 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-02ddce50-6fc5-4428-bc3c-b96791ab7c4b tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:54.399652 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-02ddce50-6fc5-4428-bc3c-b96791ab7c4b tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:54.400068 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.network.neutron [None req-e53fb6c2-4a1b-494e-abc2-d904b7dc9573 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] validate_networks() for [('5831de5e-0ff3-4415-b956-35183f0be5e2', None, None, None, None, None)] {{(pid=127198) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 16:33:54.400174 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-02ddce50-6fc5-4428-bc3c-b96791ab7c4b tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:54.400499 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-02ddce50-6fc5-4428-bc3c-b96791ab7c4b tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:54.710227 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-02ddce50-6fc5-4428-bc3c-b96791ab7c4b tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] 10.222.0.23 "POST /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.327132 Sep 09 16:33:54.717440 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 164/325] 10.222.0.23 () {60 vars in 1323 bytes} [Fri Sep 9 16:33:54 2022] POST /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698/os-volume_attachments => generated 194 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 16:33:54.914093 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-e53fb6c2-4a1b-494e-abc2-d904b7dc9573 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Flavor limits 0:0:0 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 16:33:54.915235 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-e53fb6c2-4a1b-494e-abc2-d904b7dc9573 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Image limits 0:0:0 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 16:33:54.915717 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-e53fb6c2-4a1b-494e-abc2-d904b7dc9573 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Flavor pref 0:0:0 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 16:33:54.916124 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-e53fb6c2-4a1b-494e-abc2-d904b7dc9573 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Image pref 0:0:0 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 16:33:54.916528 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-e53fb6c2-4a1b-494e-abc2-d904b7dc9573 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 16:33:54.927617 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e53fb6c2-4a1b-494e-abc2-d904b7dc9573 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:54.928421 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e53fb6c2-4a1b-494e-abc2-d904b7dc9573 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:54.929059 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e53fb6c2-4a1b-494e-abc2-d904b7dc9573 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:54.929923 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e53fb6c2-4a1b-494e-abc2-d904b7dc9573 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:54.930768 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e53fb6c2-4a1b-494e-abc2-d904b7dc9573 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:54.931170 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e53fb6c2-4a1b-494e-abc2-d904b7dc9573 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:54.951180 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.quota [None req-e53fb6c2-4a1b-494e-abc2-d904b7dc9573 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Getting quotas for project e17967a941be4a04bbc180e2cf3a7a55. Resources: {'cores', 'instances', 'ram'} {{(pid=127198) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 16:33:54.956020 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.quota [None req-e53fb6c2-4a1b-494e-abc2-d904b7dc9573 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Getting quotas for user 53c0721dc18343b18993ff5af098841d and project e17967a941be4a04bbc180e2cf3a7a55. Resources: {'cores', 'instances', 'ram'} {{(pid=127198) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 16:33:54.968748 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-e53fb6c2-4a1b-494e-abc2-d904b7dc9573 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Going to run 1 instances... {{(pid=127198) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 16:33:54.971917 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-e53fb6c2-4a1b-494e-abc2-d904b7dc9573 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] [instance: 0294b919-efa9-40c8-8b3d-d83e5ce0af54] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0b1ba34f-2223-497a-9a18-c2ad8d398aae',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127198) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 16:33:55.028625 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-e53fb6c2-4a1b-494e-abc2-d904b7dc9573 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.807304 Sep 09 16:33:55.029932 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 162/326] 10.222.0.23 () {60 vars in 1147 bytes} [Fri Sep 9 16:33:54 2022] POST /compute/v2.1/servers => generated 401 bytes in 809 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 16:33:55.042434 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-ee172bb5-c9b9-431f-91c6-03835c5d604e tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:33:55.044438 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-ee172bb5-c9b9-431f-91c6-03835c5d604e tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] [instance: 0294b919-efa9-40c8-8b3d-d83e5ce0af54] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:33:55.099934 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-d89ef088-c14a-4897-914f-337baee1a730 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:33:55.100553 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-d89ef088-c14a-4897-914f-337baee1a730 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: cc41312a-3de8-4584-9bcf-a1f31b952025] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:33:55.107813 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d89ef088-c14a-4897-914f-337baee1a730 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:55.108985 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d89ef088-c14a-4897-914f-337baee1a730 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:55.109667 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d89ef088-c14a-4897-914f-337baee1a730 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:55.110709 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d89ef088-c14a-4897-914f-337baee1a730 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:55.111373 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d89ef088-c14a-4897-914f-337baee1a730 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:55.111999 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d89ef088-c14a-4897-914f-337baee1a730 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:55.116304 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-ee172bb5-c9b9-431f-91c6-03835c5d604e tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c0721dc18343b18993ff5af098841d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17967a941be4a04bbc180e2cf3a7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:33:55.124336 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-ee172bb5-c9b9-431f-91c6-03835c5d604e tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] 10.222.0.23 "GET /compute/v2.1/servers/0294b919-efa9-40c8-8b3d-d83e5ce0af54" status: 200 len: 1242 microversion: 2.1 time: 0.086858 Sep 09 16:33:55.140649 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 165/327] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:33:55 2022] GET /compute/v2.1/servers/0294b919-efa9-40c8-8b3d-d83e5ce0af54 => generated 1242 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 16:33:55.278602 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-d89ef088-c14a-4897-914f-337baee1a730 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d86f09c6304121be2021cb5c15e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ab544d0b547919794e3efb49ba0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:33:55.287616 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-d89ef088-c14a-4897-914f-337baee1a730 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/cc41312a-3de8-4584-9bcf-a1f31b952025" status: 200 len: 1522 microversion: 2.1 time: 0.191759 Sep 09 16:33:55.303086 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 163/328] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:33:55 2022] GET /compute/v2.1/servers/cc41312a-3de8-4584-9bcf-a1f31b952025 => generated 1522 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:33:56.149582 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-8e8ba56a-5e3d-40a4-abce-bd997ef84220 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:33:56.150522 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-8e8ba56a-5e3d-40a4-abce-bd997ef84220 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] [instance: 0294b919-efa9-40c8-8b3d-d83e5ce0af54] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:33:56.159054 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-8e8ba56a-5e3d-40a4-abce-bd997ef84220 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:56.159792 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-8e8ba56a-5e3d-40a4-abce-bd997ef84220 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:56.160638 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-8e8ba56a-5e3d-40a4-abce-bd997ef84220 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:56.161507 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-8e8ba56a-5e3d-40a4-abce-bd997ef84220 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:56.162151 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-8e8ba56a-5e3d-40a4-abce-bd997ef84220 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:56.162762 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-8e8ba56a-5e3d-40a4-abce-bd997ef84220 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:56.241308 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-8e8ba56a-5e3d-40a4-abce-bd997ef84220 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c0721dc18343b18993ff5af098841d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17967a941be4a04bbc180e2cf3a7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:33:56.249718 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-8e8ba56a-5e3d-40a4-abce-bd997ef84220 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] 10.222.0.23 "GET /compute/v2.1/servers/0294b919-efa9-40c8-8b3d-d83e5ce0af54" status: 200 len: 1294 microversion: 2.1 time: 0.104260 Sep 09 16:33:56.250405 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 166/329] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:33:56 2022] GET /compute/v2.1/servers/0294b919-efa9-40c8-8b3d-d83e5ce0af54 => generated 1294 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:33:56.313043 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-56b8e8bf-1036-4b63-9858-7a9ef3fabd9c tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:33:56.320361 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-56b8e8bf-1036-4b63-9858-7a9ef3fabd9c tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: cc41312a-3de8-4584-9bcf-a1f31b952025] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:33:56.327422 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-56b8e8bf-1036-4b63-9858-7a9ef3fabd9c tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:56.342025 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-56b8e8bf-1036-4b63-9858-7a9ef3fabd9c tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:56.342823 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-56b8e8bf-1036-4b63-9858-7a9ef3fabd9c tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:56.344428 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-56b8e8bf-1036-4b63-9858-7a9ef3fabd9c tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:56.346187 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-56b8e8bf-1036-4b63-9858-7a9ef3fabd9c tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:56.347853 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-56b8e8bf-1036-4b63-9858-7a9ef3fabd9c tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:56.593938 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-56b8e8bf-1036-4b63-9858-7a9ef3fabd9c tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d86f09c6304121be2021cb5c15e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ab544d0b547919794e3efb49ba0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:33:56.605041 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-56b8e8bf-1036-4b63-9858-7a9ef3fabd9c tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/cc41312a-3de8-4584-9bcf-a1f31b952025" status: 200 len: 1522 microversion: 2.1 time: 0.296327 Sep 09 16:33:56.605860 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 164/330] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:33:56 2022] GET /compute/v2.1/servers/cc41312a-3de8-4584-9bcf-a1f31b952025 => generated 1522 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:33:57.275178 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-89c478a2-4b7b-456c-afe5-46bcb859fe5f tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:33:57.276581 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-89c478a2-4b7b-456c-afe5-46bcb859fe5f tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] [instance: 0294b919-efa9-40c8-8b3d-d83e5ce0af54] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:33:57.284590 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-89c478a2-4b7b-456c-afe5-46bcb859fe5f tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:57.286000 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-89c478a2-4b7b-456c-afe5-46bcb859fe5f tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:57.286652 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-89c478a2-4b7b-456c-afe5-46bcb859fe5f tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:57.287644 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-89c478a2-4b7b-456c-afe5-46bcb859fe5f tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:57.288264 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-89c478a2-4b7b-456c-afe5-46bcb859fe5f tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:57.289054 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-89c478a2-4b7b-456c-afe5-46bcb859fe5f tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:57.581824 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-89c478a2-4b7b-456c-afe5-46bcb859fe5f tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c0721dc18343b18993ff5af098841d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17967a941be4a04bbc180e2cf3a7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:33:57.600285 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-89c478a2-4b7b-456c-afe5-46bcb859fe5f tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] 10.222.0.23 "GET /compute/v2.1/servers/0294b919-efa9-40c8-8b3d-d83e5ce0af54" status: 200 len: 1367 microversion: 2.1 time: 0.329086 Sep 09 16:33:57.601653 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 167/331] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:33:57 2022] GET /compute/v2.1/servers/0294b919-efa9-40c8-8b3d-d83e5ce0af54 => generated 1367 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:33:57.628278 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-4e587333-15ac-484f-bc1a-b50ebaa317ca tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:33:57.629691 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-4e587333-15ac-484f-bc1a-b50ebaa317ca tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: cc41312a-3de8-4584-9bcf-a1f31b952025] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:33:57.637067 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4e587333-15ac-484f-bc1a-b50ebaa317ca tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:57.637615 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4e587333-15ac-484f-bc1a-b50ebaa317ca tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:57.638054 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4e587333-15ac-484f-bc1a-b50ebaa317ca tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:57.638843 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4e587333-15ac-484f-bc1a-b50ebaa317ca tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:57.639248 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4e587333-15ac-484f-bc1a-b50ebaa317ca tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:57.639674 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4e587333-15ac-484f-bc1a-b50ebaa317ca tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:57.887799 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-4e587333-15ac-484f-bc1a-b50ebaa317ca tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d86f09c6304121be2021cb5c15e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ab544d0b547919794e3efb49ba0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:33:57.901022 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-4e587333-15ac-484f-bc1a-b50ebaa317ca tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/cc41312a-3de8-4584-9bcf-a1f31b952025" status: 200 len: 1522 microversion: 2.1 time: 0.276559 Sep 09 16:33:57.901825 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 165/332] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:33:57 2022] GET /compute/v2.1/servers/cc41312a-3de8-4584-9bcf-a1f31b952025 => generated 1522 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:33:58.379958 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [req-e0dcc01b-8109-412c-bf45-1914b9fae78f req-9bd40b2f-a116-4e5c-adf5-7fc844b7d53c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0294b919-efa9-40c8-8b3d-d83e5ce0af54", "tag": "14294f4c-5948-4136-a2cc-6ad6dfcab540"}]} {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:33:58.418904 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [req-e0dcc01b-8109-412c-bf45-1914b9fae78f req-9bd40b2f-a116-4e5c-adf5-7fc844b7d53c service nova] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:58.418904 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [req-e0dcc01b-8109-412c-bf45-1914b9fae78f req-9bd40b2f-a116-4e5c-adf5-7fc844b7d53c service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:58.418904 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [req-e0dcc01b-8109-412c-bf45-1914b9fae78f req-9bd40b2f-a116-4e5c-adf5-7fc844b7d53c service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:58.431564 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.compute.server_external_events [req-e0dcc01b-8109-412c-bf45-1914b9fae78f req-9bd40b2f-a116-4e5c-adf5-7fc844b7d53c service nova] Creating event network-changed:14294f4c-5948-4136-a2cc-6ad6dfcab540 for instance 0294b919-efa9-40c8-8b3d-d83e5ce0af54 on hv-cinder-83124 Sep 09 16:33:58.437135 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [req-e0dcc01b-8109-412c-bf45-1914b9fae78f req-9bd40b2f-a116-4e5c-adf5-7fc844b7d53c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072592 Sep 09 16:33:58.437553 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 168/333] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Sep 9 16:33:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:33:58.625159 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-39a5791c-6e2b-414c-83f1-fb6878a3a5ee tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:33:58.625775 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-39a5791c-6e2b-414c-83f1-fb6878a3a5ee tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] [instance: 0294b919-efa9-40c8-8b3d-d83e5ce0af54] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:33:58.632269 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-39a5791c-6e2b-414c-83f1-fb6878a3a5ee tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:58.632867 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-39a5791c-6e2b-414c-83f1-fb6878a3a5ee tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:58.633101 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-39a5791c-6e2b-414c-83f1-fb6878a3a5ee tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:58.633788 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-39a5791c-6e2b-414c-83f1-fb6878a3a5ee tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:58.634276 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-39a5791c-6e2b-414c-83f1-fb6878a3a5ee tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:58.634742 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-39a5791c-6e2b-414c-83f1-fb6878a3a5ee tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:58.824261 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-39a5791c-6e2b-414c-83f1-fb6878a3a5ee tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c0721dc18343b18993ff5af098841d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17967a941be4a04bbc180e2cf3a7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:33:58.832473 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-39a5791c-6e2b-414c-83f1-fb6878a3a5ee tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] 10.222.0.23 "GET /compute/v2.1/servers/0294b919-efa9-40c8-8b3d-d83e5ce0af54" status: 200 len: 1367 microversion: 2.1 time: 0.211213 Sep 09 16:33:58.833025 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 166/334] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:33:58 2022] GET /compute/v2.1/servers/0294b919-efa9-40c8-8b3d-d83e5ce0af54 => generated 1367 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:33:58.924251 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-9a6dd337-1c79-4a76-a022-cf18f4763d30 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:33:58.924953 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-9a6dd337-1c79-4a76-a022-cf18f4763d30 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: cc41312a-3de8-4584-9bcf-a1f31b952025] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:33:58.931262 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-9a6dd337-1c79-4a76-a022-cf18f4763d30 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:58.931745 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-9a6dd337-1c79-4a76-a022-cf18f4763d30 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:58.932183 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-9a6dd337-1c79-4a76-a022-cf18f4763d30 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:58.932912 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-9a6dd337-1c79-4a76-a022-cf18f4763d30 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:58.933369 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-9a6dd337-1c79-4a76-a022-cf18f4763d30 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:58.933794 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-9a6dd337-1c79-4a76-a022-cf18f4763d30 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:59.070916 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-9a6dd337-1c79-4a76-a022-cf18f4763d30 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d86f09c6304121be2021cb5c15e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ab544d0b547919794e3efb49ba0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:33:59.078909 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-9a6dd337-1c79-4a76-a022-cf18f4763d30 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/cc41312a-3de8-4584-9bcf-a1f31b952025" status: 200 len: 1522 microversion: 2.1 time: 0.159256 Sep 09 16:33:59.079492 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 169/335] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:33:58 2022] GET /compute/v2.1/servers/cc41312a-3de8-4584-9bcf-a1f31b952025 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:33:59.855574 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-6a7d6417-c416-4de6-aab1-92a498ab131d tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:33:59.856290 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-6a7d6417-c416-4de6-aab1-92a498ab131d tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] [instance: 0294b919-efa9-40c8-8b3d-d83e5ce0af54] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:33:59.862906 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6a7d6417-c416-4de6-aab1-92a498ab131d tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:59.863300 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6a7d6417-c416-4de6-aab1-92a498ab131d tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:59.863886 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6a7d6417-c416-4de6-aab1-92a498ab131d tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:33:59.864562 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6a7d6417-c416-4de6-aab1-92a498ab131d tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:33:59.865122 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6a7d6417-c416-4de6-aab1-92a498ab131d tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:33:59.865466 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6a7d6417-c416-4de6-aab1-92a498ab131d tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:34:00.009119 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-6a7d6417-c416-4de6-aab1-92a498ab131d tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c0721dc18343b18993ff5af098841d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17967a941be4a04bbc180e2cf3a7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:34:00.018003 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-6a7d6417-c416-4de6-aab1-92a498ab131d tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] 10.222.0.23 "GET /compute/v2.1/servers/0294b919-efa9-40c8-8b3d-d83e5ce0af54" status: 200 len: 1367 microversion: 2.1 time: 0.166731 Sep 09 16:34:00.019797 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 167/336] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:33:59 2022] GET /compute/v2.1/servers/0294b919-efa9-40c8-8b3d-d83e5ce0af54 => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:34:00.104606 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-e616976b-651a-444f-abbe-082da071bc95 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:34:00.105473 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-e616976b-651a-444f-abbe-082da071bc95 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: cc41312a-3de8-4584-9bcf-a1f31b952025] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:34:00.118405 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e616976b-651a-444f-abbe-082da071bc95 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:34:00.119419 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e616976b-651a-444f-abbe-082da071bc95 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:34:00.120498 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e616976b-651a-444f-abbe-082da071bc95 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:34:00.121851 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e616976b-651a-444f-abbe-082da071bc95 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:34:00.122797 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e616976b-651a-444f-abbe-082da071bc95 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:34:00.123372 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e616976b-651a-444f-abbe-082da071bc95 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:34:00.319718 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-e616976b-651a-444f-abbe-082da071bc95 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d86f09c6304121be2021cb5c15e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ab544d0b547919794e3efb49ba0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:34:00.327378 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-e616976b-651a-444f-abbe-082da071bc95 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/cc41312a-3de8-4584-9bcf-a1f31b952025" status: 200 len: 1522 microversion: 2.1 time: 0.228546 Sep 09 16:34:00.327973 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 170/337] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:34:00 2022] GET /compute/v2.1/servers/cc41312a-3de8-4584-9bcf-a1f31b952025 => generated 1522 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:34:01.045610 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-6d2c005a-666e-4c27-9809-ea5478c6409c tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:34:01.047093 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-6d2c005a-666e-4c27-9809-ea5478c6409c tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] [instance: 0294b919-efa9-40c8-8b3d-d83e5ce0af54] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:34:01.059782 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6d2c005a-666e-4c27-9809-ea5478c6409c tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:34:01.059975 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6d2c005a-666e-4c27-9809-ea5478c6409c tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:34:01.060301 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6d2c005a-666e-4c27-9809-ea5478c6409c tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:34:01.060999 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6d2c005a-666e-4c27-9809-ea5478c6409c tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:34:01.061448 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6d2c005a-666e-4c27-9809-ea5478c6409c tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:34:01.061866 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6d2c005a-666e-4c27-9809-ea5478c6409c tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:34:01.195991 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-6d2c005a-666e-4c27-9809-ea5478c6409c tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c0721dc18343b18993ff5af098841d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17967a941be4a04bbc180e2cf3a7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:34:01.205998 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-6d2c005a-666e-4c27-9809-ea5478c6409c tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] 10.222.0.23 "GET /compute/v2.1/servers/0294b919-efa9-40c8-8b3d-d83e5ce0af54" status: 200 len: 1367 microversion: 2.1 time: 0.166734 Sep 09 16:34:01.206770 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 168/338] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:34:01 2022] GET /compute/v2.1/servers/0294b919-efa9-40c8-8b3d-d83e5ce0af54 => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:34:01.349860 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-e82e1429-7fe0-4031-9219-62f55039d4de tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:34:01.350449 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-e82e1429-7fe0-4031-9219-62f55039d4de tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: cc41312a-3de8-4584-9bcf-a1f31b952025] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:34:01.357084 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e82e1429-7fe0-4031-9219-62f55039d4de tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:34:01.357562 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e82e1429-7fe0-4031-9219-62f55039d4de tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:34:01.357994 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e82e1429-7fe0-4031-9219-62f55039d4de tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:34:01.358998 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e82e1429-7fe0-4031-9219-62f55039d4de tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:34:01.359521 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e82e1429-7fe0-4031-9219-62f55039d4de tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:34:01.359942 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e82e1429-7fe0-4031-9219-62f55039d4de tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:34:01.558748 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-e82e1429-7fe0-4031-9219-62f55039d4de tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d86f09c6304121be2021cb5c15e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ab544d0b547919794e3efb49ba0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:34:01.567370 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-e82e1429-7fe0-4031-9219-62f55039d4de tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/cc41312a-3de8-4584-9bcf-a1f31b952025" status: 200 len: 1522 microversion: 2.1 time: 0.221354 Sep 09 16:34:01.568055 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 171/339] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:34:01 2022] GET /compute/v2.1/servers/cc41312a-3de8-4584-9bcf-a1f31b952025 => generated 1522 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:34:02.142667 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [req-e5eed116-83d7-450e-a4aa-f7e78639748d req-f9424ca8-ec9f-4293-bf47-05b7b72a030c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0294b919-efa9-40c8-8b3d-d83e5ce0af54", "name": "network-vif-plugged", "status": "completed", "tag": "14294f4c-5948-4136-a2cc-6ad6dfcab540"}]} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:34:02.153204 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-e5eed116-83d7-450e-a4aa-f7e78639748d req-f9424ca8-ec9f-4293-bf47-05b7b72a030c service nova] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:34:02.153809 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-e5eed116-83d7-450e-a4aa-f7e78639748d req-f9424ca8-ec9f-4293-bf47-05b7b72a030c service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:34:02.154464 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-e5eed116-83d7-450e-a4aa-f7e78639748d req-f9424ca8-ec9f-4293-bf47-05b7b72a030c service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:34:02.161109 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:34:02.168870 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.compute.server_external_events [req-e5eed116-83d7-450e-a4aa-f7e78639748d req-f9424ca8-ec9f-4293-bf47-05b7b72a030c service nova] Creating event network-vif-plugged:14294f4c-5948-4136-a2cc-6ad6dfcab540 for instance 0294b919-efa9-40c8-8b3d-d83e5ce0af54 on hv-cinder-83124 Sep 09 16:34:02.174531 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [req-e5eed116-83d7-450e-a4aa-f7e78639748d req-f9424ca8-ec9f-4293-bf47-05b7b72a030c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035947 Sep 09 16:34:02.175259 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 169/340] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Sep 9 16:34:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:34:02.229200 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-dce305ef-2c3e-4bbc-90e5-62c74e045f0b tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:34:02.229808 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-dce305ef-2c3e-4bbc-90e5-62c74e045f0b tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] [instance: 0294b919-efa9-40c8-8b3d-d83e5ce0af54] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:34:02.238277 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-dce305ef-2c3e-4bbc-90e5-62c74e045f0b tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:34:02.238838 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-dce305ef-2c3e-4bbc-90e5-62c74e045f0b tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:34:02.239270 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-dce305ef-2c3e-4bbc-90e5-62c74e045f0b tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:34:02.239962 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-dce305ef-2c3e-4bbc-90e5-62c74e045f0b tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:34:02.240707 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-dce305ef-2c3e-4bbc-90e5-62c74e045f0b tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:34:02.241358 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-dce305ef-2c3e-4bbc-90e5-62c74e045f0b tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:34:02.357353 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-9b1744d5-e256-4858-9c8b-bfa203d9b6b3 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:34:02.366787 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9b1744d5-e256-4858-9c8b-bfa203d9b6b3 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:34:02.367533 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9b1744d5-e256-4858-9c8b-bfa203d9b6b3 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:34:02.367968 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9b1744d5-e256-4858-9c8b-bfa203d9b6b3 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:34:02.433080 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-9b1744d5-e256-4858-9c8b-bfa203d9b6b3 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] [instance: 9e761961-9c74-444c-bb4b-0b2f82a9d698] Going to try to stop instance {{(pid=127198) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 09 16:34:02.459770 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-dce305ef-2c3e-4bbc-90e5-62c74e045f0b tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c0721dc18343b18993ff5af098841d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17967a941be4a04bbc180e2cf3a7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:34:02.469370 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-dce305ef-2c3e-4bbc-90e5-62c74e045f0b tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] 10.222.0.23 "GET /compute/v2.1/servers/0294b919-efa9-40c8-8b3d-d83e5ce0af54" status: 200 len: 1367 microversion: 2.1 time: 0.243953 Sep 09 16:34:02.471057 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 172/341] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:34:02 2022] GET /compute/v2.1/servers/0294b919-efa9-40c8-8b3d-d83e5ce0af54 => generated 1367 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:34:02.492065 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-9b1744d5-e256-4858-9c8b-bfa203d9b6b3 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] 10.222.0.23 "POST /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698/action" status: 202 len: 0 microversion: 2.1 time: 0.138911 Sep 09 16:34:02.492891 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 170/342] 10.222.0.23 () {60 vars in 1278 bytes} [Fri Sep 9 16:34:02 2022] POST /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698/action => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 16:34:02.501158 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-9193bbca-376b-4dd9-9f0e-9f05ed84b388 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:34:02.501922 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-9193bbca-376b-4dd9-9f0e-9f05ed84b388 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] [instance: 9e761961-9c74-444c-bb4b-0b2f82a9d698] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:34:02.508004 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-9193bbca-376b-4dd9-9f0e-9f05ed84b388 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:34:02.508478 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-9193bbca-376b-4dd9-9f0e-9f05ed84b388 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:34:02.508905 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-9193bbca-376b-4dd9-9f0e-9f05ed84b388 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:34:02.509586 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-9193bbca-376b-4dd9-9f0e-9f05ed84b388 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:34:02.510052 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-9193bbca-376b-4dd9-9f0e-9f05ed84b388 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:34:02.510451 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-9193bbca-376b-4dd9-9f0e-9f05ed84b388 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:34:02.592795 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-d6ae5166-e02c-4125-8c9f-10e5a453b62b tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:34:02.593483 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-d6ae5166-e02c-4125-8c9f-10e5a453b62b tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: cc41312a-3de8-4584-9bcf-a1f31b952025] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:34:02.599812 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d6ae5166-e02c-4125-8c9f-10e5a453b62b tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:34:02.600555 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d6ae5166-e02c-4125-8c9f-10e5a453b62b tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:34:02.601169 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d6ae5166-e02c-4125-8c9f-10e5a453b62b tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:34:02.602036 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d6ae5166-e02c-4125-8c9f-10e5a453b62b tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:34:02.602735 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d6ae5166-e02c-4125-8c9f-10e5a453b62b tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:34:02.603333 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d6ae5166-e02c-4125-8c9f-10e5a453b62b tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:34:02.656124 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-9193bbca-376b-4dd9-9f0e-9f05ed84b388 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd095ed814b9e47e08d6b5a4fd2901c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f2e0c002343d88ae25dc7bfb2fe10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:34:02.664804 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-9193bbca-376b-4dd9-9f0e-9f05ed84b388 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] 10.222.0.23 "GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698" status: 200 len: 1722 microversion: 2.1 time: 0.167671 Sep 09 16:34:02.670556 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 173/343] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:34:02 2022] GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698 => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:34:02.744257 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-d6ae5166-e02c-4125-8c9f-10e5a453b62b tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d86f09c6304121be2021cb5c15e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ab544d0b547919794e3efb49ba0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:34:02.752422 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-d6ae5166-e02c-4125-8c9f-10e5a453b62b tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/cc41312a-3de8-4584-9bcf-a1f31b952025" status: 200 len: 1522 microversion: 2.1 time: 0.164959 Sep 09 16:34:02.753049 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 171/344] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:34:02 2022] GET /compute/v2.1/servers/cc41312a-3de8-4584-9bcf-a1f31b952025 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 16:34:03.493898 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-b8c27ef0-57e6-4c7a-9716-8db6d03e6c85 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:34:03.494801 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-b8c27ef0-57e6-4c7a-9716-8db6d03e6c85 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] [instance: 0294b919-efa9-40c8-8b3d-d83e5ce0af54] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:34:03.501296 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-b8c27ef0-57e6-4c7a-9716-8db6d03e6c85 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:34:03.501851 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-b8c27ef0-57e6-4c7a-9716-8db6d03e6c85 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:34:03.502337 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-b8c27ef0-57e6-4c7a-9716-8db6d03e6c85 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:34:03.503286 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-b8c27ef0-57e6-4c7a-9716-8db6d03e6c85 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:34:03.503856 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-b8c27ef0-57e6-4c7a-9716-8db6d03e6c85 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:34:03.504192 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-b8c27ef0-57e6-4c7a-9716-8db6d03e6c85 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:34:03.649877 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-b8c27ef0-57e6-4c7a-9716-8db6d03e6c85 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c0721dc18343b18993ff5af098841d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17967a941be4a04bbc180e2cf3a7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:34:03.655903 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-b8c27ef0-57e6-4c7a-9716-8db6d03e6c85 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] 10.222.0.23 "GET /compute/v2.1/servers/0294b919-efa9-40c8-8b3d-d83e5ce0af54" status: 200 len: 1367 microversion: 2.1 time: 0.166177 Sep 09 16:34:03.656473 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 174/345] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:34:03 2022] GET /compute/v2.1/servers/0294b919-efa9-40c8-8b3d-d83e5ce0af54 => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:34:03.688693 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-f782695d-13f7-499b-b64e-4c4b2599a06a tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:34:03.689323 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-f782695d-13f7-499b-b64e-4c4b2599a06a tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] [instance: 9e761961-9c74-444c-bb4b-0b2f82a9d698] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:34:03.695809 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f782695d-13f7-499b-b64e-4c4b2599a06a tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:34:03.696282 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f782695d-13f7-499b-b64e-4c4b2599a06a tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:34:03.696727 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f782695d-13f7-499b-b64e-4c4b2599a06a tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:34:03.697376 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f782695d-13f7-499b-b64e-4c4b2599a06a tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:34:03.697819 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f782695d-13f7-499b-b64e-4c4b2599a06a tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:34:03.698233 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f782695d-13f7-499b-b64e-4c4b2599a06a tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:34:03.776782 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-a3f11691-d435-4e99-8ae5-e52c8831dab3 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:34:03.777408 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-a3f11691-d435-4e99-8ae5-e52c8831dab3 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: cc41312a-3de8-4584-9bcf-a1f31b952025] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:34:03.783426 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-a3f11691-d435-4e99-8ae5-e52c8831dab3 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:34:03.783909 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-a3f11691-d435-4e99-8ae5-e52c8831dab3 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:34:03.784343 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-a3f11691-d435-4e99-8ae5-e52c8831dab3 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:34:03.785032 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-a3f11691-d435-4e99-8ae5-e52c8831dab3 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:34:03.785483 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-a3f11691-d435-4e99-8ae5-e52c8831dab3 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:34:03.785887 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-a3f11691-d435-4e99-8ae5-e52c8831dab3 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:34:03.838906 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-f782695d-13f7-499b-b64e-4c4b2599a06a tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd095ed814b9e47e08d6b5a4fd2901c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f2e0c002343d88ae25dc7bfb2fe10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:34:03.847653 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-f782695d-13f7-499b-b64e-4c4b2599a06a tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] 10.222.0.23 "GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698" status: 200 len: 1722 microversion: 2.1 time: 0.162812 Sep 09 16:34:03.848208 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 172/346] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:34:03 2022] GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:34:03.922812 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-a3f11691-d435-4e99-8ae5-e52c8831dab3 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d86f09c6304121be2021cb5c15e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ab544d0b547919794e3efb49ba0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:34:03.932274 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-a3f11691-d435-4e99-8ae5-e52c8831dab3 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/cc41312a-3de8-4584-9bcf-a1f31b952025" status: 200 len: 1522 microversion: 2.1 time: 0.159514 Sep 09 16:34:03.932830 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 175/347] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:34:03 2022] GET /compute/v2.1/servers/cc41312a-3de8-4584-9bcf-a1f31b952025 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:34:04.679354 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-6dfc4b9d-6802-4867-984b-8a424bcd7a0c tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:34:04.679955 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-6dfc4b9d-6802-4867-984b-8a424bcd7a0c tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] [instance: 0294b919-efa9-40c8-8b3d-d83e5ce0af54] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:34:04.686387 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6dfc4b9d-6802-4867-984b-8a424bcd7a0c tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:34:04.686935 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6dfc4b9d-6802-4867-984b-8a424bcd7a0c tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:34:04.687374 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6dfc4b9d-6802-4867-984b-8a424bcd7a0c tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:34:04.688199 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6dfc4b9d-6802-4867-984b-8a424bcd7a0c tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:34:04.688653 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6dfc4b9d-6802-4867-984b-8a424bcd7a0c tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:34:04.689073 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6dfc4b9d-6802-4867-984b-8a424bcd7a0c tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:34:04.825981 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-6dfc4b9d-6802-4867-984b-8a424bcd7a0c tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c0721dc18343b18993ff5af098841d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17967a941be4a04bbc180e2cf3a7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:34:04.834619 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-6dfc4b9d-6802-4867-984b-8a424bcd7a0c tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] 10.222.0.23 "GET /compute/v2.1/servers/0294b919-efa9-40c8-8b3d-d83e5ce0af54" status: 200 len: 1558 microversion: 2.1 time: 0.159433 Sep 09 16:34:04.835189 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 173/348] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:34:04 2022] GET /compute/v2.1/servers/0294b919-efa9-40c8-8b3d-d83e5ce0af54 => generated 1558 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:34:04.857277 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-f83bd5d4-8ea7-4f10-b46a-98b21011b0fe tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:34:04.857849 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-f83bd5d4-8ea7-4f10-b46a-98b21011b0fe tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] [instance: 0294b919-efa9-40c8-8b3d-d83e5ce0af54] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:34:04.864844 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f83bd5d4-8ea7-4f10-b46a-98b21011b0fe tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:34:04.865332 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f83bd5d4-8ea7-4f10-b46a-98b21011b0fe tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:34:04.865746 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f83bd5d4-8ea7-4f10-b46a-98b21011b0fe tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:34:04.866664 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f83bd5d4-8ea7-4f10-b46a-98b21011b0fe tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:34:04.867111 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f83bd5d4-8ea7-4f10-b46a-98b21011b0fe tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:34:04.867534 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f83bd5d4-8ea7-4f10-b46a-98b21011b0fe tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:34:04.870364 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-5b047ac2-3391-448d-93df-de742f12d37f tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:34:04.870999 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-5b047ac2-3391-448d-93df-de742f12d37f tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] [instance: 9e761961-9c74-444c-bb4b-0b2f82a9d698] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:34:04.873458 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG dbcounter [-] [127196] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:34:04.877835 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5b047ac2-3391-448d-93df-de742f12d37f tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:34:04.878361 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5b047ac2-3391-448d-93df-de742f12d37f tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:34:04.878891 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5b047ac2-3391-448d-93df-de742f12d37f tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:34:04.879698 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5b047ac2-3391-448d-93df-de742f12d37f tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:34:04.880155 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5b047ac2-3391-448d-93df-de742f12d37f tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:34:04.880591 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5b047ac2-3391-448d-93df-de742f12d37f tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:34:04.939860 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell0:SELECT=2 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:34:04.963558 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell0:SELECT=6 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:34:04.984178 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-f83bd5d4-8ea7-4f10-b46a-98b21011b0fe tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] 10.222.0.23 "GET /compute/v2.1/servers/0294b919-efa9-40c8-8b3d-d83e5ce0af54/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.130838 Sep 09 16:34:04.984797 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 176/349] 10.222.0.23 () {58 vars in 1275 bytes} [Fri Sep 9 16:34:04 2022] GET /compute/v2.1/servers/0294b919-efa9-40c8-8b3d-d83e5ce0af54/os-interface => generated 285 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:34:04.990736 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-d4e35cf1-f0ea-4c25-b145-f36d7c7981fa tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:34:04.990736 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-d4e35cf1-f0ea-4c25-b145-f36d7c7981fa tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: cc41312a-3de8-4584-9bcf-a1f31b952025] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:34:04.997431 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-d4e35cf1-f0ea-4c25-b145-f36d7c7981fa tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:34:04.997931 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-d4e35cf1-f0ea-4c25-b145-f36d7c7981fa tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:34:04.998323 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-d4e35cf1-f0ea-4c25-b145-f36d7c7981fa tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:34:04.999125 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-d4e35cf1-f0ea-4c25-b145-f36d7c7981fa tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:34:04.999511 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-d4e35cf1-f0ea-4c25-b145-f36d7c7981fa tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:34:04.999936 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-d4e35cf1-f0ea-4c25-b145-f36d7c7981fa tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:34:05.057986 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-5b047ac2-3391-448d-93df-de742f12d37f tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd095ed814b9e47e08d6b5a4fd2901c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f2e0c002343d88ae25dc7bfb2fe10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:34:05.066418 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-5b047ac2-3391-448d-93df-de742f12d37f tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] 10.222.0.23 "GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698" status: 200 len: 1722 microversion: 2.1 time: 0.199843 Sep 09 16:34:05.067426 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 174/350] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:34:04 2022] GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698 => generated 1722 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:34:05.124295 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG dbcounter [-] [127196] Writing DB stats nova_cell0:SELECT=6 {{(pid=127196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:34:05.150454 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-d4e35cf1-f0ea-4c25-b145-f36d7c7981fa tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d86f09c6304121be2021cb5c15e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ab544d0b547919794e3efb49ba0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:34:05.158348 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-d4e35cf1-f0ea-4c25-b145-f36d7c7981fa tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/cc41312a-3de8-4584-9bcf-a1f31b952025" status: 200 len: 1522 microversion: 2.1 time: 0.172598 Sep 09 16:34:05.158938 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 177/351] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:34:04 2022] GET /compute/v2.1/servers/cc41312a-3de8-4584-9bcf-a1f31b952025 => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:34:05.976334 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [req-2806d9bd-0e7d-4050-80a3-81340c748a66 req-62cbdf1d-d8e1-4890-b009-1b82171f69c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0294b919-efa9-40c8-8b3d-d83e5ce0af54", "tag": "14294f4c-5948-4136-a2cc-6ad6dfcab540"}]} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:34:05.986477 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-2806d9bd-0e7d-4050-80a3-81340c748a66 req-62cbdf1d-d8e1-4890-b009-1b82171f69c1 service nova] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:34:05.986968 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-2806d9bd-0e7d-4050-80a3-81340c748a66 req-62cbdf1d-d8e1-4890-b009-1b82171f69c1 service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:34:05.987411 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-2806d9bd-0e7d-4050-80a3-81340c748a66 req-62cbdf1d-d8e1-4890-b009-1b82171f69c1 service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:34:05.998314 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.compute.server_external_events [req-2806d9bd-0e7d-4050-80a3-81340c748a66 req-62cbdf1d-d8e1-4890-b009-1b82171f69c1 service nova] Creating event network-changed:14294f4c-5948-4136-a2cc-6ad6dfcab540 for instance 0294b919-efa9-40c8-8b3d-d83e5ce0af54 on hv-cinder-83124 Sep 09 16:34:06.003297 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [req-2806d9bd-0e7d-4050-80a3-81340c748a66 req-62cbdf1d-d8e1-4890-b009-1b82171f69c1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030841 Sep 09 16:34:06.003847 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 175/352] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Sep 9 16:34:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:34:06.089753 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-ff52aabb-c3fd-40e9-a3ff-2c3a8a0543cc tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:34:06.090364 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-ff52aabb-c3fd-40e9-a3ff-2c3a8a0543cc tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] [instance: 9e761961-9c74-444c-bb4b-0b2f82a9d698] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:34:06.096933 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-ff52aabb-c3fd-40e9-a3ff-2c3a8a0543cc tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:34:06.097616 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-ff52aabb-c3fd-40e9-a3ff-2c3a8a0543cc tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:34:06.098093 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-ff52aabb-c3fd-40e9-a3ff-2c3a8a0543cc tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:34:06.098822 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-ff52aabb-c3fd-40e9-a3ff-2c3a8a0543cc tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:34:06.099272 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-ff52aabb-c3fd-40e9-a3ff-2c3a8a0543cc tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:34:06.099855 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-ff52aabb-c3fd-40e9-a3ff-2c3a8a0543cc tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:34:06.182388 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-99b87743-a438-478e-b6f2-1d12390f4578 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:34:06.183153 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-99b87743-a438-478e-b6f2-1d12390f4578 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: cc41312a-3de8-4584-9bcf-a1f31b952025] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:34:06.192215 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-99b87743-a438-478e-b6f2-1d12390f4578 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:34:06.192706 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-99b87743-a438-478e-b6f2-1d12390f4578 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:34:06.193139 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-99b87743-a438-478e-b6f2-1d12390f4578 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:34:06.193837 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-99b87743-a438-478e-b6f2-1d12390f4578 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:34:06.194461 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-99b87743-a438-478e-b6f2-1d12390f4578 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:34:06.194922 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-99b87743-a438-478e-b6f2-1d12390f4578 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:34:06.620310 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-ff52aabb-c3fd-40e9-a3ff-2c3a8a0543cc tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd095ed814b9e47e08d6b5a4fd2901c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f2e0c002343d88ae25dc7bfb2fe10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:34:06.629513 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-ff52aabb-c3fd-40e9-a3ff-2c3a8a0543cc tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] 10.222.0.23 "GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698" status: 200 len: 1722 microversion: 2.1 time: 0.543506 Sep 09 16:34:06.645602 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 178/353] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:34:06 2022] GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698 => generated 1722 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:34:06.705642 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-99b87743-a438-478e-b6f2-1d12390f4578 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d86f09c6304121be2021cb5c15e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ab544d0b547919794e3efb49ba0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:34:06.714056 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-99b87743-a438-478e-b6f2-1d12390f4578 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/cc41312a-3de8-4584-9bcf-a1f31b952025" status: 200 len: 1522 microversion: 2.1 time: 0.536097 Sep 09 16:34:06.714992 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 176/354] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:34:06 2022] GET /compute/v2.1/servers/cc41312a-3de8-4584-9bcf-a1f31b952025 => generated 1522 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 16:34:07.656071 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-e1124993-538f-4091-a3ae-278b4e69255a tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:34:07.657060 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-e1124993-538f-4091-a3ae-278b4e69255a tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] [instance: 9e761961-9c74-444c-bb4b-0b2f82a9d698] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:34:07.667459 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e1124993-538f-4091-a3ae-278b4e69255a tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:34:07.668222 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e1124993-538f-4091-a3ae-278b4e69255a tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:34:07.668845 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e1124993-538f-4091-a3ae-278b4e69255a tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:34:07.670029 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e1124993-538f-4091-a3ae-278b4e69255a tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:34:07.670691 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e1124993-538f-4091-a3ae-278b4e69255a tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:34:07.671597 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e1124993-538f-4091-a3ae-278b4e69255a tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:34:07.737543 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-509bd87a-16c1-4cd6-9cc2-f3a7ab05a2b2 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:34:07.738258 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-509bd87a-16c1-4cd6-9cc2-f3a7ab05a2b2 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: cc41312a-3de8-4584-9bcf-a1f31b952025] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:34:07.745196 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-509bd87a-16c1-4cd6-9cc2-f3a7ab05a2b2 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:34:07.745709 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-509bd87a-16c1-4cd6-9cc2-f3a7ab05a2b2 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:34:07.746131 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-509bd87a-16c1-4cd6-9cc2-f3a7ab05a2b2 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:34:07.746918 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-509bd87a-16c1-4cd6-9cc2-f3a7ab05a2b2 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:34:07.747358 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-509bd87a-16c1-4cd6-9cc2-f3a7ab05a2b2 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:34:07.747763 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-509bd87a-16c1-4cd6-9cc2-f3a7ab05a2b2 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:34:07.851670 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-e1124993-538f-4091-a3ae-278b4e69255a tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd095ed814b9e47e08d6b5a4fd2901c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f2e0c002343d88ae25dc7bfb2fe10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:34:07.860621 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-e1124993-538f-4091-a3ae-278b4e69255a tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] 10.222.0.23 "GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698" status: 200 len: 1722 microversion: 2.1 time: 0.210161 Sep 09 16:34:07.861178 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 179/355] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:34:07 2022] GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698 => generated 1722 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:34:07.896843 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-509bd87a-16c1-4cd6-9cc2-f3a7ab05a2b2 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d86f09c6304121be2021cb5c15e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ab544d0b547919794e3efb49ba0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:34:07.904500 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-509bd87a-16c1-4cd6-9cc2-f3a7ab05a2b2 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/cc41312a-3de8-4584-9bcf-a1f31b952025" status: 200 len: 1522 microversion: 2.1 time: 0.171098 Sep 09 16:34:07.905057 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 177/356] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:34:07 2022] GET /compute/v2.1/servers/cc41312a-3de8-4584-9bcf-a1f31b952025 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 16:34:08.890599 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-c3ca3ee9-c5e9-46b0-94da-e6bb8dbf4a5d tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:34:08.891663 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-c3ca3ee9-c5e9-46b0-94da-e6bb8dbf4a5d tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] [instance: 9e761961-9c74-444c-bb4b-0b2f82a9d698] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:34:08.894456 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG dbcounter [-] [127196] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=1 {{(pid=127196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:34:08.904008 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-c3ca3ee9-c5e9-46b0-94da-e6bb8dbf4a5d tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:34:08.904804 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-c3ca3ee9-c5e9-46b0-94da-e6bb8dbf4a5d tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:34:08.905578 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-c3ca3ee9-c5e9-46b0-94da-e6bb8dbf4a5d tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:34:08.906836 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-c3ca3ee9-c5e9-46b0-94da-e6bb8dbf4a5d tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:34:08.907594 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-c3ca3ee9-c5e9-46b0-94da-e6bb8dbf4a5d tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:34:08.908291 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-c3ca3ee9-c5e9-46b0-94da-e6bb8dbf4a5d tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:34:08.931677 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-f3bf24f1-3fef-41d2-9341-0ad653d034b9 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:34:08.932452 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-f3bf24f1-3fef-41d2-9341-0ad653d034b9 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: cc41312a-3de8-4584-9bcf-a1f31b952025] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:34:08.943005 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f3bf24f1-3fef-41d2-9341-0ad653d034b9 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:34:08.945498 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f3bf24f1-3fef-41d2-9341-0ad653d034b9 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:34:08.946012 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f3bf24f1-3fef-41d2-9341-0ad653d034b9 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:34:08.947118 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f3bf24f1-3fef-41d2-9341-0ad653d034b9 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:34:08.947609 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f3bf24f1-3fef-41d2-9341-0ad653d034b9 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:34:08.948239 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f3bf24f1-3fef-41d2-9341-0ad653d034b9 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:34:09.119066 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-c3ca3ee9-c5e9-46b0-94da-e6bb8dbf4a5d tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd095ed814b9e47e08d6b5a4fd2901c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f2e0c002343d88ae25dc7bfb2fe10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:34:09.127684 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-c3ca3ee9-c5e9-46b0-94da-e6bb8dbf4a5d tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] 10.222.0.23 "GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698" status: 200 len: 1722 microversion: 2.1 time: 0.244124 Sep 09 16:34:09.128344 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 180/357] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:34:08 2022] GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698 => generated 1722 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:34:09.142804 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-f3bf24f1-3fef-41d2-9341-0ad653d034b9 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d86f09c6304121be2021cb5c15e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ab544d0b547919794e3efb49ba0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:34:09.151739 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-f3bf24f1-3fef-41d2-9341-0ad653d034b9 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/cc41312a-3de8-4584-9bcf-a1f31b952025" status: 200 len: 1522 microversion: 2.1 time: 0.224360 Sep 09 16:34:09.152323 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 178/358] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:34:08 2022] GET /compute/v2.1/servers/cc41312a-3de8-4584-9bcf-a1f31b952025 => generated 1522 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:34:10.152201 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-9f533be2-5b2f-4ce3-9432-5aee14a1c55a tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:34:10.152787 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-9f533be2-5b2f-4ce3-9432-5aee14a1c55a tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] [instance: 9e761961-9c74-444c-bb4b-0b2f82a9d698] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:34:10.161171 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-9f533be2-5b2f-4ce3-9432-5aee14a1c55a tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:34:10.161743 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-9f533be2-5b2f-4ce3-9432-5aee14a1c55a tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:34:10.162285 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-9f533be2-5b2f-4ce3-9432-5aee14a1c55a tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:34:10.163421 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-9f533be2-5b2f-4ce3-9432-5aee14a1c55a tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:34:10.163876 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-9f533be2-5b2f-4ce3-9432-5aee14a1c55a tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:34:10.164298 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-9f533be2-5b2f-4ce3-9432-5aee14a1c55a tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:34:10.174946 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-63258f23-a9bd-4634-a524-9d6bc0f8c30f tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:34:10.175617 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-63258f23-a9bd-4634-a524-9d6bc0f8c30f tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: cc41312a-3de8-4584-9bcf-a1f31b952025] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:34:10.182785 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-63258f23-a9bd-4634-a524-9d6bc0f8c30f tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:34:10.183264 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-63258f23-a9bd-4634-a524-9d6bc0f8c30f tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:34:10.183686 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-63258f23-a9bd-4634-a524-9d6bc0f8c30f tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:34:10.184487 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-63258f23-a9bd-4634-a524-9d6bc0f8c30f tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:34:10.184951 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-63258f23-a9bd-4634-a524-9d6bc0f8c30f tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:34:10.185359 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-63258f23-a9bd-4634-a524-9d6bc0f8c30f tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:34:10.368026 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-9f533be2-5b2f-4ce3-9432-5aee14a1c55a tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd095ed814b9e47e08d6b5a4fd2901c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f2e0c002343d88ae25dc7bfb2fe10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:34:10.373065 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-63258f23-a9bd-4634-a524-9d6bc0f8c30f tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d86f09c6304121be2021cb5c15e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ab544d0b547919794e3efb49ba0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:34:10.376576 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-9f533be2-5b2f-4ce3-9432-5aee14a1c55a tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] 10.222.0.23 "GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698" status: 200 len: 1722 microversion: 2.1 time: 0.229134 Sep 09 16:34:10.377411 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 181/359] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:34:10 2022] GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698 => generated 1722 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:34:10.381175 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-63258f23-a9bd-4634-a524-9d6bc0f8c30f tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/cc41312a-3de8-4584-9bcf-a1f31b952025" status: 200 len: 1522 microversion: 2.1 time: 0.210507 Sep 09 16:34:10.381736 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 179/360] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:34:10 2022] GET /compute/v2.1/servers/cc41312a-3de8-4584-9bcf-a1f31b952025 => generated 1522 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:34:11.400590 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-9eb1458f-0654-476f-81b8-ab73d01c3dee tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:34:11.401249 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-9eb1458f-0654-476f-81b8-ab73d01c3dee tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] [instance: 9e761961-9c74-444c-bb4b-0b2f82a9d698] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:34:11.406270 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-c9dc50fa-a7db-4594-8dbc-9b6a1176cbed tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:34:11.407077 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-c9dc50fa-a7db-4594-8dbc-9b6a1176cbed tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: cc41312a-3de8-4584-9bcf-a1f31b952025] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:34:11.408098 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-9eb1458f-0654-476f-81b8-ab73d01c3dee tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:34:11.408598 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-9eb1458f-0654-476f-81b8-ab73d01c3dee tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:34:11.409022 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-9eb1458f-0654-476f-81b8-ab73d01c3dee tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:34:11.409723 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-9eb1458f-0654-476f-81b8-ab73d01c3dee tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:34:11.410175 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-9eb1458f-0654-476f-81b8-ab73d01c3dee tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:34:11.410625 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-9eb1458f-0654-476f-81b8-ab73d01c3dee tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:34:11.413780 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c9dc50fa-a7db-4594-8dbc-9b6a1176cbed tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:34:11.414331 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c9dc50fa-a7db-4594-8dbc-9b6a1176cbed tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:34:11.414790 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c9dc50fa-a7db-4594-8dbc-9b6a1176cbed tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:34:11.415558 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c9dc50fa-a7db-4594-8dbc-9b6a1176cbed tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:34:11.416018 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c9dc50fa-a7db-4594-8dbc-9b6a1176cbed tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:34:11.416438 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c9dc50fa-a7db-4594-8dbc-9b6a1176cbed tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:34:11.616475 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-9eb1458f-0654-476f-81b8-ab73d01c3dee tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd095ed814b9e47e08d6b5a4fd2901c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f2e0c002343d88ae25dc7bfb2fe10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:34:11.619966 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-c9dc50fa-a7db-4594-8dbc-9b6a1176cbed tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d86f09c6304121be2021cb5c15e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ab544d0b547919794e3efb49ba0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:34:11.626445 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-9eb1458f-0654-476f-81b8-ab73d01c3dee tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] 10.222.0.23 "GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698" status: 200 len: 1722 microversion: 2.1 time: 0.230021 Sep 09 16:34:11.630744 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 182/361] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:34:11 2022] GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698 => generated 1722 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:34:11.630961 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-c9dc50fa-a7db-4594-8dbc-9b6a1176cbed tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/cc41312a-3de8-4584-9bcf-a1f31b952025" status: 200 len: 1502 microversion: 2.1 time: 0.228085 Sep 09 16:34:11.630961 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 180/362] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:34:11 2022] GET /compute/v2.1/servers/cc41312a-3de8-4584-9bcf-a1f31b952025 => generated 1502 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 16:34:11.653153 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-255201c6-f4fa-492c-8228-1befc284f7c8 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aba1e59b-29a2-4c29-bea1-bd3beb49be91"}} {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:34:11.655545 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-255201c6-f4fa-492c-8228-1befc284f7c8 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: cc41312a-3de8-4584-9bcf-a1f31b952025] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:34:11.662103 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-255201c6-f4fa-492c-8228-1befc284f7c8 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:34:11.662603 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-255201c6-f4fa-492c-8228-1befc284f7c8 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:34:11.663085 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-255201c6-f4fa-492c-8228-1befc284f7c8 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:34:11.663776 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-255201c6-f4fa-492c-8228-1befc284f7c8 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:34:11.664228 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-255201c6-f4fa-492c-8228-1befc284f7c8 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:34:11.664649 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-255201c6-f4fa-492c-8228-1befc284f7c8 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:34:11.688526 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.wsgi [None req-255201c6-f4fa-492c-8228-1befc284f7c8 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] HTTP exception thrown: Cannot 'attach_volume' instance cc41312a-3de8-4584-9bcf-a1f31b952025 while it is in vm_state rescued Sep 09 16:34:11.690206 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-255201c6-f4fa-492c-8228-1befc284f7c8 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Request method failure captured: Sep 09 16:34:11.690206 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: request: POST /compute/v2.1/servers/cc41312a-3de8-4584-9bcf-a1f31b952025/os-volume_attachments HTTP/1.1 Sep 09 16:34:11.690206 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Accept: application/json Sep 09 16:34:11.690206 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Accept-Encoding: identity Sep 09 16:34:11.690206 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Connection: close Sep 09 16:34:11.690206 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Content-Length: 74 Sep 09 16:34:11.690206 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Content-Type: application/json Sep 09 16:34:11.690206 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Host: 10.222.0.23 Sep 09 16:34:11.690206 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Openstack-System-Scope: None Sep 09 16:34:11.690206 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: User-Agent: python-urllib3/1.26.12 Sep 09 16:34:11.690206 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Auth-Token: gAAAAABjG2p-0YVzE1C54y4YHzerR9fl8ogYekOzuznZ1bfrL9kUVfW6Ih02eq7nOq40QjAAw9fvfdATGoMCwd4vVva2idcU68ciSkDoKd8Q2lSb22phiMWNOP_KzlG5zPAX_USx2tS2bKk8URzwp5NdlHntDfA3_G1B81ZhfjolUxo8_fp6MfY Sep 09 16:34:11.690206 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Domain-Id: None Sep 09 16:34:11.690206 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Domain-Name: None Sep 09 16:34:11.690206 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Identity-Status: Confirmed Sep 09 16:34:11.690206 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Is-Admin-Project: True Sep 09 16:34:11.690206 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Project-Domain-Id: default Sep 09 16:34:11.690206 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Project-Domain-Name: Default Sep 09 16:34:11.690206 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Project-Id: d21ab544d0b547919794e3efb49ba0e9 Sep 09 16:34:11.690206 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1054417282 Sep 09 16:34:11.690206 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Role: member,reader Sep 09 16:34:11.690206 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Roles: member,reader Sep 09 16:34:11.691544 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d21ab544d0b547919794e3efb49ba0e9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d21ab544d0b547919794e3efb49ba0e9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d21ab544d0b547919794e3efb49ba0e9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d21ab544d0b547919794e3efb49ba0e9"}]}] Sep 09 16:34:11.691544 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1054417282 Sep 09 16:34:11.691544 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Tenant-Id: d21ab544d0b547919794e3efb49ba0e9 Sep 09 16:34:11.691544 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1054417282 Sep 09 16:34:11.691544 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-User: tempest-ServerRescueNegativeTestJSON-1054417282-project Sep 09 16:34:11.691544 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-User-Domain-Id: default Sep 09 16:34:11.691544 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-User-Domain-Name: Default Sep 09 16:34:11.691544 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-User-Id: 67d86f09c6304121be2021cb5c15e63e Sep 09 16:34:11.691544 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1054417282-project Sep 09 16:34:11.691544 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Sep 09 16:34:11.691544 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: {"volumeAttachment": {"volumeId": "aba1e59b-29a2-4c29-bea1-bd3beb49be91"}} Sep 09 16:34:11.691544 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: method: > Sep 09 16:34:11.692241 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: exception: Cannot 'attach_volume' instance cc41312a-3de8-4584-9bcf-a1f31b952025 while it is in vm_state rescued Sep 09 16:34:11.692241 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: action_args: {'server_id': 'cc41312a-3de8-4584-9bcf-a1f31b952025', 'body': {'volumeAttachment': {'volumeId': 'aba1e59b-29a2-4c29-bea1-bd3beb49be91'}}} Sep 09 16:34:11.692241 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 16:34:11.692241 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:34:11.692241 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 09 16:34:11.692241 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 09 16:34:11.692241 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 09 16:34:11.692241 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 09 16:34:11.692241 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 09 16:34:11.692241 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 09 16:34:11.692241 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance cc41312a-3de8-4584-9bcf-a1f31b952025 in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 09 16:34:11.692241 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Sep 09 16:34:11.692241 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 16:34:11.692241 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Sep 09 16:34:11.692241 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:34:11.692241 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 16:34:11.692241 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 16:34:11.692241 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 16:34:11.692241 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 16:34:11.693528 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 16:34:11.693528 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 16:34:11.693528 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 09 16:34:11.693528 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 16:34:11.693528 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 09 16:34:11.693528 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 16:34:11.693528 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 09 16:34:11.693528 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 16:34:11.693528 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 09 16:34:11.693528 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 09 16:34:11.693528 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 09 16:34:11.693528 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 09 16:34:11.693528 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance cc41312a-3de8-4584-9bcf-a1f31b952025 while it is in vm_state rescued Sep 09 16:34:11.693528 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Sep 09 16:34:11.693528 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 16:34:11.693528 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Sep 09 16:34:11.693528 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:34:11.693528 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 16:34:11.693528 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 16:34:11.695013 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 16:34:11.695013 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 16:34:11.695013 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance cc41312a-3de8-4584-9bcf-a1f31b952025 while it is in vm_state rescued Sep 09 16:34:11.695013 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Sep 09 16:34:11.695013 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-255201c6-f4fa-492c-8228-1befc284f7c8 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Returning 409 to user: Cannot 'attach_volume' instance cc41312a-3de8-4584-9bcf-a1f31b952025 while it is in vm_state rescued {{(pid=127196) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 16:34:11.695013 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-255201c6-f4fa-492c-8228-1befc284f7c8 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "POST /compute/v2.1/servers/cc41312a-3de8-4584-9bcf-a1f31b952025/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.042920 Sep 09 16:34:11.695013 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 183/363] 10.222.0.23 () {60 vars in 1323 bytes} [Fri Sep 9 16:34:11 2022] POST /compute/v2.1/servers/cc41312a-3de8-4584-9bcf-a1f31b952025/os-volume_attachments => generated 152 bytes in 44 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 09 16:34:11.701613 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-788e84e8-e65c-427a-8ecb-0f216e379d34 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:34:11.702191 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-788e84e8-e65c-427a-8ecb-0f216e379d34 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: cc41312a-3de8-4584-9bcf-a1f31b952025] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:34:11.708683 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-788e84e8-e65c-427a-8ecb-0f216e379d34 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:34:11.709136 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-788e84e8-e65c-427a-8ecb-0f216e379d34 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:34:11.709576 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-788e84e8-e65c-427a-8ecb-0f216e379d34 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:34:11.710257 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-788e84e8-e65c-427a-8ecb-0f216e379d34 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:34:11.710793 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-788e84e8-e65c-427a-8ecb-0f216e379d34 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:34:11.711217 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-788e84e8-e65c-427a-8ecb-0f216e379d34 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:34:11.779131 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-788e84e8-e65c-427a-8ecb-0f216e379d34 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "POST /compute/v2.1/servers/cc41312a-3de8-4584-9bcf-a1f31b952025/action" status: 202 len: 0 microversion: 2.1 time: 0.081181 Sep 09 16:34:11.782841 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 181/364] 10.222.0.23 () {60 vars in 1278 bytes} [Fri Sep 9 16:34:11 2022] POST /compute/v2.1/servers/cc41312a-3de8-4584-9bcf-a1f31b952025/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 16:34:11.788190 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-3251e7ad-18ca-4f75-b9a5-63e4889b46be tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:34:11.788800 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-3251e7ad-18ca-4f75-b9a5-63e4889b46be tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: cc41312a-3de8-4584-9bcf-a1f31b952025] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:34:11.794894 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-3251e7ad-18ca-4f75-b9a5-63e4889b46be tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:34:11.795373 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-3251e7ad-18ca-4f75-b9a5-63e4889b46be tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:34:11.795806 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-3251e7ad-18ca-4f75-b9a5-63e4889b46be tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:34:11.796879 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-3251e7ad-18ca-4f75-b9a5-63e4889b46be tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:34:11.797313 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-3251e7ad-18ca-4f75-b9a5-63e4889b46be tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:34:11.797730 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-3251e7ad-18ca-4f75-b9a5-63e4889b46be tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:34:12.021374 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-3251e7ad-18ca-4f75-b9a5-63e4889b46be tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d86f09c6304121be2021cb5c15e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ab544d0b547919794e3efb49ba0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:34:12.033136 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-3251e7ad-18ca-4f75-b9a5-63e4889b46be tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/cc41312a-3de8-4584-9bcf-a1f31b952025" status: 200 len: 1510 microversion: 2.1 time: 0.248785 Sep 09 16:34:12.033722 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 184/365] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:34:11 2022] GET /compute/v2.1/servers/cc41312a-3de8-4584-9bcf-a1f31b952025 => generated 1510 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:34:12.664639 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-a8fbe15e-1fe8-4c1d-979d-992dcf465737 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:34:12.665333 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-a8fbe15e-1fe8-4c1d-979d-992dcf465737 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] [instance: 9e761961-9c74-444c-bb4b-0b2f82a9d698] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:34:12.672755 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a8fbe15e-1fe8-4c1d-979d-992dcf465737 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:34:12.673270 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a8fbe15e-1fe8-4c1d-979d-992dcf465737 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:34:12.673702 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a8fbe15e-1fe8-4c1d-979d-992dcf465737 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:34:12.674403 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a8fbe15e-1fe8-4c1d-979d-992dcf465737 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:34:12.674888 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a8fbe15e-1fe8-4c1d-979d-992dcf465737 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:34:12.675308 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a8fbe15e-1fe8-4c1d-979d-992dcf465737 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:34:12.820293 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-a8fbe15e-1fe8-4c1d-979d-992dcf465737 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd095ed814b9e47e08d6b5a4fd2901c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f2e0c002343d88ae25dc7bfb2fe10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:34:12.830251 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-a8fbe15e-1fe8-4c1d-979d-992dcf465737 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] 10.222.0.23 "GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698" status: 200 len: 1722 microversion: 2.1 time: 0.171809 Sep 09 16:34:12.831036 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 182/366] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:34:12 2022] GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698 => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:34:13.058885 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-bd4e159a-4658-4b76-996d-d4913407081d tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:34:13.059523 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-bd4e159a-4658-4b76-996d-d4913407081d tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: cc41312a-3de8-4584-9bcf-a1f31b952025] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:34:13.067337 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-bd4e159a-4658-4b76-996d-d4913407081d tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:34:13.067834 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-bd4e159a-4658-4b76-996d-d4913407081d tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:34:13.068467 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-bd4e159a-4658-4b76-996d-d4913407081d tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:34:13.069420 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-bd4e159a-4658-4b76-996d-d4913407081d tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:34:13.070046 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-bd4e159a-4658-4b76-996d-d4913407081d tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:34:13.070597 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-bd4e159a-4658-4b76-996d-d4913407081d tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:34:13.204405 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-bd4e159a-4658-4b76-996d-d4913407081d tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d86f09c6304121be2021cb5c15e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ab544d0b547919794e3efb49ba0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:34:13.212438 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-bd4e159a-4658-4b76-996d-d4913407081d tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/cc41312a-3de8-4584-9bcf-a1f31b952025" status: 200 len: 1510 microversion: 2.1 time: 0.157734 Sep 09 16:34:13.213022 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 185/367] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:34:13 2022] GET /compute/v2.1/servers/cc41312a-3de8-4584-9bcf-a1f31b952025 => generated 1510 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:34:13.858320 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-ac974565-dc24-4f03-b8d1-9af24a0db23d tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:34:13.859119 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-ac974565-dc24-4f03-b8d1-9af24a0db23d tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] [instance: 9e761961-9c74-444c-bb4b-0b2f82a9d698] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:34:13.867932 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ac974565-dc24-4f03-b8d1-9af24a0db23d tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:34:13.868541 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ac974565-dc24-4f03-b8d1-9af24a0db23d tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:34:13.869081 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ac974565-dc24-4f03-b8d1-9af24a0db23d tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:34:13.869988 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ac974565-dc24-4f03-b8d1-9af24a0db23d tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:34:13.870540 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ac974565-dc24-4f03-b8d1-9af24a0db23d tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:34:13.871116 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ac974565-dc24-4f03-b8d1-9af24a0db23d tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:34:14.012592 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-ac974565-dc24-4f03-b8d1-9af24a0db23d tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd095ed814b9e47e08d6b5a4fd2901c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f2e0c002343d88ae25dc7bfb2fe10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:34:14.020996 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-ac974565-dc24-4f03-b8d1-9af24a0db23d tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] 10.222.0.23 "GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698" status: 200 len: 1722 microversion: 2.1 time: 0.168233 Sep 09 16:34:14.021584 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 183/368] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:34:13 2022] GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698 => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:34:14.237363 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-b4c2db52-b1ea-409b-904e-7cec7ab9e4e8 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:34:14.238007 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-b4c2db52-b1ea-409b-904e-7cec7ab9e4e8 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: cc41312a-3de8-4584-9bcf-a1f31b952025] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:34:14.245847 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-b4c2db52-b1ea-409b-904e-7cec7ab9e4e8 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:34:14.246359 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-b4c2db52-b1ea-409b-904e-7cec7ab9e4e8 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:34:14.246802 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-b4c2db52-b1ea-409b-904e-7cec7ab9e4e8 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:34:14.247502 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-b4c2db52-b1ea-409b-904e-7cec7ab9e4e8 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:34:14.247956 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-b4c2db52-b1ea-409b-904e-7cec7ab9e4e8 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:34:14.248379 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-b4c2db52-b1ea-409b-904e-7cec7ab9e4e8 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:34:14.394228 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-b4c2db52-b1ea-409b-904e-7cec7ab9e4e8 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d86f09c6304121be2021cb5c15e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ab544d0b547919794e3efb49ba0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:34:14.402984 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-b4c2db52-b1ea-409b-904e-7cec7ab9e4e8 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/cc41312a-3de8-4584-9bcf-a1f31b952025" status: 200 len: 1510 microversion: 2.1 time: 0.170522 Sep 09 16:34:14.403551 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 186/369] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:34:14 2022] GET /compute/v2.1/servers/cc41312a-3de8-4584-9bcf-a1f31b952025 => generated 1510 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:34:15.047969 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-9d9d74ef-9eb3-4fb8-b9f5-423ca838e13a tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:34:15.048622 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-9d9d74ef-9eb3-4fb8-b9f5-423ca838e13a tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] [instance: 9e761961-9c74-444c-bb4b-0b2f82a9d698] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:34:15.057271 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9d9d74ef-9eb3-4fb8-b9f5-423ca838e13a tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:34:15.057752 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9d9d74ef-9eb3-4fb8-b9f5-423ca838e13a tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:34:15.058183 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9d9d74ef-9eb3-4fb8-b9f5-423ca838e13a tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:34:15.058919 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9d9d74ef-9eb3-4fb8-b9f5-423ca838e13a tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:34:15.059380 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9d9d74ef-9eb3-4fb8-b9f5-423ca838e13a tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:34:15.059802 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9d9d74ef-9eb3-4fb8-b9f5-423ca838e13a tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:34:15.203197 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-9d9d74ef-9eb3-4fb8-b9f5-423ca838e13a tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd095ed814b9e47e08d6b5a4fd2901c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f2e0c002343d88ae25dc7bfb2fe10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:34:15.212120 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-9d9d74ef-9eb3-4fb8-b9f5-423ca838e13a tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] 10.222.0.23 "GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698" status: 200 len: 1722 microversion: 2.1 time: 0.170798 Sep 09 16:34:15.212682 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 184/370] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:34:15 2022] GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698 => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:34:15.425557 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-e3c09fa4-de39-4844-bd95-8f33decf7aa3 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:34:15.426239 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-e3c09fa4-de39-4844-bd95-8f33decf7aa3 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: cc41312a-3de8-4584-9bcf-a1f31b952025] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:34:15.433022 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e3c09fa4-de39-4844-bd95-8f33decf7aa3 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:34:15.433486 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e3c09fa4-de39-4844-bd95-8f33decf7aa3 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:34:15.433908 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e3c09fa4-de39-4844-bd95-8f33decf7aa3 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:34:15.434745 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e3c09fa4-de39-4844-bd95-8f33decf7aa3 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:34:15.435198 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e3c09fa4-de39-4844-bd95-8f33decf7aa3 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:34:15.435610 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e3c09fa4-de39-4844-bd95-8f33decf7aa3 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:34:15.571971 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-e3c09fa4-de39-4844-bd95-8f33decf7aa3 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d86f09c6304121be2021cb5c15e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ab544d0b547919794e3efb49ba0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:34:15.580239 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-e3c09fa4-de39-4844-bd95-8f33decf7aa3 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/cc41312a-3de8-4584-9bcf-a1f31b952025" status: 200 len: 1516 microversion: 2.1 time: 0.158882 Sep 09 16:34:15.581098 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 187/371] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:34:15 2022] GET /compute/v2.1/servers/cc41312a-3de8-4584-9bcf-a1f31b952025 => generated 1516 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:34:16.236509 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-9e9b9e67-df32-4f12-b318-48f91f21bdf0 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:34:16.237568 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-9e9b9e67-df32-4f12-b318-48f91f21bdf0 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] [instance: 9e761961-9c74-444c-bb4b-0b2f82a9d698] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:34:16.243793 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9e9b9e67-df32-4f12-b318-48f91f21bdf0 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:34:16.244375 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9e9b9e67-df32-4f12-b318-48f91f21bdf0 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:34:16.244783 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9e9b9e67-df32-4f12-b318-48f91f21bdf0 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:34:16.245505 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9e9b9e67-df32-4f12-b318-48f91f21bdf0 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:34:16.245957 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9e9b9e67-df32-4f12-b318-48f91f21bdf0 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:34:16.246361 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9e9b9e67-df32-4f12-b318-48f91f21bdf0 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:34:16.250475 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:34:16.377044 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-9e9b9e67-df32-4f12-b318-48f91f21bdf0 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd095ed814b9e47e08d6b5a4fd2901c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f2e0c002343d88ae25dc7bfb2fe10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:34:16.385951 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-9e9b9e67-df32-4f12-b318-48f91f21bdf0 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] 10.222.0.23 "GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698" status: 200 len: 1722 microversion: 2.1 time: 0.153523 Sep 09 16:34:16.386545 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 185/372] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:34:16 2022] GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:34:16.958030 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-b8078a07-5cc5-4807-9e89-fffbdeb3e8e6 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Action: 'create', calling method: .version_select at 0x7f24fba12ca0>, body: {"keypair": {"name": "tempest-keypair-1794755995", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEFzc8Ou90FqT6sRbb4M1ffnqdo7NVn4mxz/4HScHWOE81jcPOxxrSaJMudek2IVdNtTmLUGqhTIaJzCTIWT/e6dAOKl2IBnhKvRyAm4kcUzHyqu2DVMu87LdF+4wp0MfQ=="}} {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:34:16.974979 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.quota [None req-b8078a07-5cc5-4807-9e89-fffbdeb3e8e6 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Getting quotas for project d21ab544d0b547919794e3efb49ba0e9. Resources: {'key_pairs'} {{(pid=127196) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 16:34:16.978978 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.quota [None req-b8078a07-5cc5-4807-9e89-fffbdeb3e8e6 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Getting quotas for user 67d86f09c6304121be2021cb5c15e63e and project d21ab544d0b547919794e3efb49ba0e9. Resources: {'key_pairs'} {{(pid=127196) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 16:34:17.006181 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-b8078a07-5cc5-4807-9e89-fffbdeb3e8e6 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.052067 Sep 09 16:34:17.006821 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 188/373] 10.222.0.23 () {60 vars in 1159 bytes} [Fri Sep 9 16:34:16 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:34:17.408541 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-0f6a325c-da05-468a-a40e-f6943f2474c6 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:34:17.409115 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-0f6a325c-da05-468a-a40e-f6943f2474c6 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] [instance: 9e761961-9c74-444c-bb4b-0b2f82a9d698] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:34:17.415990 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0f6a325c-da05-468a-a40e-f6943f2474c6 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:34:17.416518 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0f6a325c-da05-468a-a40e-f6943f2474c6 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:34:17.417164 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0f6a325c-da05-468a-a40e-f6943f2474c6 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:34:17.417861 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0f6a325c-da05-468a-a40e-f6943f2474c6 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:34:17.418315 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0f6a325c-da05-468a-a40e-f6943f2474c6 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:34:17.418775 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0f6a325c-da05-468a-a40e-f6943f2474c6 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:34:17.631371 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-0f6a325c-da05-468a-a40e-f6943f2474c6 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd095ed814b9e47e08d6b5a4fd2901c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f2e0c002343d88ae25dc7bfb2fe10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:34:17.640157 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-0f6a325c-da05-468a-a40e-f6943f2474c6 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] 10.222.0.23 "GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698" status: 200 len: 1722 microversion: 2.1 time: 0.235506 Sep 09 16:34:17.640726 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 186/374] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:34:17 2022] GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698 => generated 1722 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:34:18.382958 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-839cd0f4-57a0-40e6-babd-442dab51e76c tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-399870537", "imageRef": "0b1ba34f-2223-497a-9a18-c2ad8d398aae", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7b6e2f92-02dd-4b2d-b845-fc9ca1be737b"}], "security_groups": [{"name": "tempest-securitygroup--788638071"}], "key_name": "tempest-keypair-1794755995", "user_data": "}} {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:34:18.497362 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.network.neutron [None req-839cd0f4-57a0-40e6-babd-442dab51e76c tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] validate_networks() for [('7b6e2f92-02dd-4b2d-b845-fc9ca1be737b', None, None, None, None, None)] {{(pid=127196) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 16:34:18.663805 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-3e0ba10f-f67d-4fb0-9e00-d9419301a797 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:34:18.664405 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-3e0ba10f-f67d-4fb0-9e00-d9419301a797 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] [instance: 9e761961-9c74-444c-bb4b-0b2f82a9d698] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:34:18.671282 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3e0ba10f-f67d-4fb0-9e00-d9419301a797 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:34:18.671832 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3e0ba10f-f67d-4fb0-9e00-d9419301a797 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:34:18.672263 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3e0ba10f-f67d-4fb0-9e00-d9419301a797 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:34:18.672951 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3e0ba10f-f67d-4fb0-9e00-d9419301a797 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:34:18.673404 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3e0ba10f-f67d-4fb0-9e00-d9419301a797 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:34:18.673821 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3e0ba10f-f67d-4fb0-9e00-d9419301a797 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:34:18.914535 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-3e0ba10f-f67d-4fb0-9e00-d9419301a797 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd095ed814b9e47e08d6b5a4fd2901c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f2e0c002343d88ae25dc7bfb2fe10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:34:18.923763 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-3e0ba10f-f67d-4fb0-9e00-d9419301a797 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] 10.222.0.23 "GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698" status: 200 len: 1722 microversion: 2.1 time: 0.263922 Sep 09 16:34:18.924334 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 187/375] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:34:18 2022] GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698 => generated 1722 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:34:18.955373 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.virt.hardware [None req-839cd0f4-57a0-40e6-babd-442dab51e76c tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Flavor limits 0:0:0 {{(pid=127196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 16:34:18.955791 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.virt.hardware [None req-839cd0f4-57a0-40e6-babd-442dab51e76c tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Image limits 0:0:0 {{(pid=127196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 16:34:18.956262 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.virt.hardware [None req-839cd0f4-57a0-40e6-babd-442dab51e76c tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Flavor pref 0:0:0 {{(pid=127196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 16:34:18.956663 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.virt.hardware [None req-839cd0f4-57a0-40e6-babd-442dab51e76c tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Image pref 0:0:0 {{(pid=127196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 16:34:18.957079 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.virt.hardware [None req-839cd0f4-57a0-40e6-babd-442dab51e76c tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 16:34:18.966695 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-839cd0f4-57a0-40e6-babd-442dab51e76c tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:34:18.967175 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-839cd0f4-57a0-40e6-babd-442dab51e76c tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:34:18.967601 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-839cd0f4-57a0-40e6-babd-442dab51e76c tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:34:18.968314 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-839cd0f4-57a0-40e6-babd-442dab51e76c tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:34:18.968790 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-839cd0f4-57a0-40e6-babd-442dab51e76c tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:34:18.969233 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-839cd0f4-57a0-40e6-babd-442dab51e76c tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:34:18.986554 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.quota [None req-839cd0f4-57a0-40e6-babd-442dab51e76c tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Getting quotas for project d21ab544d0b547919794e3efb49ba0e9. Resources: {'cores', 'instances', 'ram'} {{(pid=127196) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 16:34:18.990917 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.quota [None req-839cd0f4-57a0-40e6-babd-442dab51e76c tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Getting quotas for user 67d86f09c6304121be2021cb5c15e63e and project d21ab544d0b547919794e3efb49ba0e9. Resources: {'cores', 'instances', 'ram'} {{(pid=127196) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 16:34:19.002433 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-839cd0f4-57a0-40e6-babd-442dab51e76c tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Going to run 1 instances... {{(pid=127196) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 16:34:19.004729 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-839cd0f4-57a0-40e6-babd-442dab51e76c tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: 994c3400-0024-457d-88c7-e59b4053062c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0b1ba34f-2223-497a-9a18-c2ad8d398aae',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127196) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 16:34:19.056614 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-839cd0f4-57a0-40e6-babd-442dab51e76c tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.681675 Sep 09 16:34:19.057187 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 189/376] 10.222.0.23 () {60 vars in 1147 bytes} [Fri Sep 9 16:34:18 2022] POST /compute/v2.1/servers => generated 408 bytes in 683 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 16:34:19.068244 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-5ce007ac-ef52-4b62-9f09-fac5ba6e2d4f tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:34:19.068847 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-5ce007ac-ef52-4b62-9f09-fac5ba6e2d4f tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: 994c3400-0024-457d-88c7-e59b4053062c] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:34:19.146010 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-5ce007ac-ef52-4b62-9f09-fac5ba6e2d4f tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d86f09c6304121be2021cb5c15e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ab544d0b547919794e3efb49ba0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:34:19.153490 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-5ce007ac-ef52-4b62-9f09-fac5ba6e2d4f tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/994c3400-0024-457d-88c7-e59b4053062c" status: 200 len: 1245 microversion: 2.1 time: 0.089087 Sep 09 16:34:19.154083 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 188/377] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:34:19 2022] GET /compute/v2.1/servers/994c3400-0024-457d-88c7-e59b4053062c => generated 1245 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:34:19.947472 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-dcb014a2-827b-481c-b4c1-15d05a33987a tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:34:19.948147 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-dcb014a2-827b-481c-b4c1-15d05a33987a tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] [instance: 9e761961-9c74-444c-bb4b-0b2f82a9d698] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:34:19.955152 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-dcb014a2-827b-481c-b4c1-15d05a33987a tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:34:19.955686 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-dcb014a2-827b-481c-b4c1-15d05a33987a tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:34:19.956119 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-dcb014a2-827b-481c-b4c1-15d05a33987a tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:34:19.956811 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-dcb014a2-827b-481c-b4c1-15d05a33987a tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:34:19.957260 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-dcb014a2-827b-481c-b4c1-15d05a33987a tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:34:19.957686 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-dcb014a2-827b-481c-b4c1-15d05a33987a tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:34:20.087576 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-dcb014a2-827b-481c-b4c1-15d05a33987a tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd095ed814b9e47e08d6b5a4fd2901c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f2e0c002343d88ae25dc7bfb2fe10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:34:20.095968 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-dcb014a2-827b-481c-b4c1-15d05a33987a tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] 10.222.0.23 "GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698" status: 200 len: 1722 microversion: 2.1 time: 0.152653 Sep 09 16:34:20.096533 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 190/378] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:34:19 2022] GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:34:20.182300 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-8842c60d-f135-4736-966a-a4ee1c832b51 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:34:20.183121 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-8842c60d-f135-4736-966a-a4ee1c832b51 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: 994c3400-0024-457d-88c7-e59b4053062c] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:34:20.191345 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8842c60d-f135-4736-966a-a4ee1c832b51 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:34:20.191910 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8842c60d-f135-4736-966a-a4ee1c832b51 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:34:20.192404 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8842c60d-f135-4736-966a-a4ee1c832b51 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:34:20.193203 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8842c60d-f135-4736-966a-a4ee1c832b51 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:34:20.193726 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8842c60d-f135-4736-966a-a4ee1c832b51 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:34:20.194213 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8842c60d-f135-4736-966a-a4ee1c832b51 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:34:20.259489 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-8842c60d-f135-4736-966a-a4ee1c832b51 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d86f09c6304121be2021cb5c15e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ab544d0b547919794e3efb49ba0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:34:20.267502 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-8842c60d-f135-4736-966a-a4ee1c832b51 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/994c3400-0024-457d-88c7-e59b4053062c" status: 200 len: 1297 microversion: 2.1 time: 0.091153 Sep 09 16:34:20.268134 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 189/379] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:34:20 2022] GET /compute/v2.1/servers/994c3400-0024-457d-88c7-e59b4053062c => generated 1297 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:34:21.119985 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-ec51939a-b3ce-4704-8834-0cf603b357bf tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:34:21.120545 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-ec51939a-b3ce-4704-8834-0cf603b357bf tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] [instance: 9e761961-9c74-444c-bb4b-0b2f82a9d698] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:34:21.127362 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-ec51939a-b3ce-4704-8834-0cf603b357bf tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:34:21.127847 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-ec51939a-b3ce-4704-8834-0cf603b357bf tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:34:21.128300 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-ec51939a-b3ce-4704-8834-0cf603b357bf tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:34:21.128982 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-ec51939a-b3ce-4704-8834-0cf603b357bf tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:34:21.129428 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-ec51939a-b3ce-4704-8834-0cf603b357bf tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:34:21.129841 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-ec51939a-b3ce-4704-8834-0cf603b357bf tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:34:21.291522 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-f8429ee3-5410-4df9-b396-bf482d5cbee6 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:34:21.292224 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-f8429ee3-5410-4df9-b396-bf482d5cbee6 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: 994c3400-0024-457d-88c7-e59b4053062c] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:34:21.294852 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=3 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:34:21.300623 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f8429ee3-5410-4df9-b396-bf482d5cbee6 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:34:21.301202 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f8429ee3-5410-4df9-b396-bf482d5cbee6 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:34:21.301689 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f8429ee3-5410-4df9-b396-bf482d5cbee6 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:34:21.302472 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f8429ee3-5410-4df9-b396-bf482d5cbee6 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:34:21.303019 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f8429ee3-5410-4df9-b396-bf482d5cbee6 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:34:21.303517 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f8429ee3-5410-4df9-b396-bf482d5cbee6 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:34:21.366735 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-ec51939a-b3ce-4704-8834-0cf603b357bf tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd095ed814b9e47e08d6b5a4fd2901c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f2e0c002343d88ae25dc7bfb2fe10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:34:21.375418 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-ec51939a-b3ce-4704-8834-0cf603b357bf tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] 10.222.0.23 "GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698" status: 200 len: 1722 microversion: 2.1 time: 0.259363 Sep 09 16:34:21.375977 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 191/380] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:34:21 2022] GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698 => generated 1722 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:34:21.507936 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-f8429ee3-5410-4df9-b396-bf482d5cbee6 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d86f09c6304121be2021cb5c15e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ab544d0b547919794e3efb49ba0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:34:21.515764 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-f8429ee3-5410-4df9-b396-bf482d5cbee6 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/994c3400-0024-457d-88c7-e59b4053062c" status: 200 len: 1370 microversion: 2.1 time: 0.228423 Sep 09 16:34:21.516319 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 190/381] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:34:21 2022] GET /compute/v2.1/servers/994c3400-0024-457d-88c7-e59b4053062c => generated 1370 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:34:22.136528 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [req-dc50d55d-3be0-4c1c-bdb8-21a23511c199 req-ae7ba79f-8623-4923-81f9-9b85601478fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "994c3400-0024-457d-88c7-e59b4053062c", "tag": "cd3987cc-b23d-4fa7-bf49-6afa802d4f4a"}]} {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:34:22.147857 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [req-dc50d55d-3be0-4c1c-bdb8-21a23511c199 req-ae7ba79f-8623-4923-81f9-9b85601478fd service nova] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:34:22.148309 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [req-dc50d55d-3be0-4c1c-bdb8-21a23511c199 req-ae7ba79f-8623-4923-81f9-9b85601478fd service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:34:22.148818 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [req-dc50d55d-3be0-4c1c-bdb8-21a23511c199 req-ae7ba79f-8623-4923-81f9-9b85601478fd service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:34:22.175878 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.compute.server_external_events [req-dc50d55d-3be0-4c1c-bdb8-21a23511c199 req-ae7ba79f-8623-4923-81f9-9b85601478fd service nova] Creating event network-changed:cd3987cc-b23d-4fa7-bf49-6afa802d4f4a for instance 994c3400-0024-457d-88c7-e59b4053062c on hv-cinder-83124 Sep 09 16:34:22.182722 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [req-dc50d55d-3be0-4c1c-bdb8-21a23511c199 req-ae7ba79f-8623-4923-81f9-9b85601478fd service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053316 Sep 09 16:34:22.184340 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 192/382] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Sep 9 16:34:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:34:22.399221 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-0f6bea2b-64f4-4d29-a274-0db3dca73106 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:34:22.399813 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-0f6bea2b-64f4-4d29-a274-0db3dca73106 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] [instance: 9e761961-9c74-444c-bb4b-0b2f82a9d698] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:34:22.406770 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0f6bea2b-64f4-4d29-a274-0db3dca73106 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:34:22.407350 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0f6bea2b-64f4-4d29-a274-0db3dca73106 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:34:22.407854 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0f6bea2b-64f4-4d29-a274-0db3dca73106 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:34:22.408638 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0f6bea2b-64f4-4d29-a274-0db3dca73106 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:34:22.409197 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0f6bea2b-64f4-4d29-a274-0db3dca73106 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:34:22.409721 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0f6bea2b-64f4-4d29-a274-0db3dca73106 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:34:22.540122 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-7f4a5e7f-baa2-4eeb-90e9-0f64644c97f9 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:34:22.540810 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-7f4a5e7f-baa2-4eeb-90e9-0f64644c97f9 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: 994c3400-0024-457d-88c7-e59b4053062c] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:34:22.547740 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-7f4a5e7f-baa2-4eeb-90e9-0f64644c97f9 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:34:22.548217 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-7f4a5e7f-baa2-4eeb-90e9-0f64644c97f9 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:34:22.548641 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-7f4a5e7f-baa2-4eeb-90e9-0f64644c97f9 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:34:22.549334 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-7f4a5e7f-baa2-4eeb-90e9-0f64644c97f9 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:34:22.549792 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-7f4a5e7f-baa2-4eeb-90e9-0f64644c97f9 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:34:22.550189 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-7f4a5e7f-baa2-4eeb-90e9-0f64644c97f9 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:34:22.750091 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-0f6bea2b-64f4-4d29-a274-0db3dca73106 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd095ed814b9e47e08d6b5a4fd2901c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f2e0c002343d88ae25dc7bfb2fe10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:34:22.758871 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-0f6bea2b-64f4-4d29-a274-0db3dca73106 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] 10.222.0.23 "GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698" status: 200 len: 1722 microversion: 2.1 time: 0.363586 Sep 09 16:34:22.759572 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 191/383] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:34:22 2022] GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698 => generated 1722 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:34:22.817294 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-7f4a5e7f-baa2-4eeb-90e9-0f64644c97f9 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d86f09c6304121be2021cb5c15e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ab544d0b547919794e3efb49ba0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:34:22.829364 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-7f4a5e7f-baa2-4eeb-90e9-0f64644c97f9 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/994c3400-0024-457d-88c7-e59b4053062c" status: 200 len: 1370 microversion: 2.1 time: 0.293275 Sep 09 16:34:22.830148 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 193/384] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:34:22 2022] GET /compute/v2.1/servers/994c3400-0024-457d-88c7-e59b4053062c => generated 1370 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:34:23.787355 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-033cf774-6912-4aa5-aed6-9b890acd3ab1 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:34:23.788205 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-033cf774-6912-4aa5-aed6-9b890acd3ab1 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] [instance: 9e761961-9c74-444c-bb4b-0b2f82a9d698] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:34:23.796359 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-033cf774-6912-4aa5-aed6-9b890acd3ab1 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:34:23.796864 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-033cf774-6912-4aa5-aed6-9b890acd3ab1 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:34:23.797318 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-033cf774-6912-4aa5-aed6-9b890acd3ab1 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:34:23.798039 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-033cf774-6912-4aa5-aed6-9b890acd3ab1 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:34:23.798544 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-033cf774-6912-4aa5-aed6-9b890acd3ab1 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:34:23.798988 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-033cf774-6912-4aa5-aed6-9b890acd3ab1 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:34:23.853442 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-83881e86-2411-42df-aad3-06fb23e4cd9f tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:34:23.854020 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-83881e86-2411-42df-aad3-06fb23e4cd9f tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: 994c3400-0024-457d-88c7-e59b4053062c] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:34:23.860631 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-83881e86-2411-42df-aad3-06fb23e4cd9f tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:34:23.861108 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-83881e86-2411-42df-aad3-06fb23e4cd9f tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:34:23.861540 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-83881e86-2411-42df-aad3-06fb23e4cd9f tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:34:23.862226 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-83881e86-2411-42df-aad3-06fb23e4cd9f tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:34:23.862764 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-83881e86-2411-42df-aad3-06fb23e4cd9f tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:34:23.863162 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-83881e86-2411-42df-aad3-06fb23e4cd9f tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:34:23.972174 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-033cf774-6912-4aa5-aed6-9b890acd3ab1 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd095ed814b9e47e08d6b5a4fd2901c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f2e0c002343d88ae25dc7bfb2fe10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:34:23.980919 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-033cf774-6912-4aa5-aed6-9b890acd3ab1 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] 10.222.0.23 "GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698" status: 200 len: 1722 microversion: 2.1 time: 0.200365 Sep 09 16:34:23.981506 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 192/385] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:34:23 2022] GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698 => generated 1722 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:34:24.019016 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-83881e86-2411-42df-aad3-06fb23e4cd9f tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d86f09c6304121be2021cb5c15e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ab544d0b547919794e3efb49ba0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:34:24.027643 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-83881e86-2411-42df-aad3-06fb23e4cd9f tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/994c3400-0024-457d-88c7-e59b4053062c" status: 200 len: 1370 microversion: 2.1 time: 0.178220 Sep 09 16:34:24.028223 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 194/386] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:34:23 2022] GET /compute/v2.1/servers/994c3400-0024-457d-88c7-e59b4053062c => generated 1370 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 16:34:25.005585 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-c35b8ac8-55b6-4826-bb8b-cdc9232a929c tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:34:25.006534 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-c35b8ac8-55b6-4826-bb8b-cdc9232a929c tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] [instance: 9e761961-9c74-444c-bb4b-0b2f82a9d698] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:34:25.013116 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c35b8ac8-55b6-4826-bb8b-cdc9232a929c tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:34:25.013602 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c35b8ac8-55b6-4826-bb8b-cdc9232a929c tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:34:25.014032 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c35b8ac8-55b6-4826-bb8b-cdc9232a929c tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:34:25.014765 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c35b8ac8-55b6-4826-bb8b-cdc9232a929c tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:34:25.015222 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c35b8ac8-55b6-4826-bb8b-cdc9232a929c tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:34:25.015640 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c35b8ac8-55b6-4826-bb8b-cdc9232a929c tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:34:25.052414 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-660a73d1-67e7-47c2-b025-0cf1a526169c tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:34:25.053647 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-660a73d1-67e7-47c2-b025-0cf1a526169c tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: 994c3400-0024-457d-88c7-e59b4053062c] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:34:25.060730 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-660a73d1-67e7-47c2-b025-0cf1a526169c tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:34:25.061213 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-660a73d1-67e7-47c2-b025-0cf1a526169c tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:34:25.061615 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-660a73d1-67e7-47c2-b025-0cf1a526169c tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:34:25.062339 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-660a73d1-67e7-47c2-b025-0cf1a526169c tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:34:25.062821 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-660a73d1-67e7-47c2-b025-0cf1a526169c tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:34:25.063240 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-660a73d1-67e7-47c2-b025-0cf1a526169c tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:34:25.196262 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-c35b8ac8-55b6-4826-bb8b-cdc9232a929c tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd095ed814b9e47e08d6b5a4fd2901c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f2e0c002343d88ae25dc7bfb2fe10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:34:25.205074 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-c35b8ac8-55b6-4826-bb8b-cdc9232a929c tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] 10.222.0.23 "GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698" status: 200 len: 1722 microversion: 2.1 time: 0.204692 Sep 09 16:34:25.205743 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 193/387] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:34:24 2022] GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698 => generated 1722 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:34:25.225527 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-660a73d1-67e7-47c2-b025-0cf1a526169c tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d86f09c6304121be2021cb5c15e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ab544d0b547919794e3efb49ba0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:34:25.229264 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG dbcounter [-] [127196] Writing DB stats nova_cell1:SELECT=100 {{(pid=127196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:34:25.234056 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-660a73d1-67e7-47c2-b025-0cf1a526169c tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/994c3400-0024-457d-88c7-e59b4053062c" status: 200 len: 1370 microversion: 2.1 time: 0.185479 Sep 09 16:34:25.234722 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 195/388] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:34:25 2022] GET /compute/v2.1/servers/994c3400-0024-457d-88c7-e59b4053062c => generated 1370 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:34:26.231954 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-41e1cf34-a22b-4572-bb4a-a7aded4200f7 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:34:26.232808 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-41e1cf34-a22b-4572-bb4a-a7aded4200f7 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] [instance: 9e761961-9c74-444c-bb4b-0b2f82a9d698] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:34:26.243304 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-41e1cf34-a22b-4572-bb4a-a7aded4200f7 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:34:26.244042 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-41e1cf34-a22b-4572-bb4a-a7aded4200f7 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:34:26.244893 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-41e1cf34-a22b-4572-bb4a-a7aded4200f7 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:34:26.245594 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-41e1cf34-a22b-4572-bb4a-a7aded4200f7 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:34:26.246048 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-41e1cf34-a22b-4572-bb4a-a7aded4200f7 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:34:26.246472 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-41e1cf34-a22b-4572-bb4a-a7aded4200f7 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:34:26.256972 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-029ad8a5-0256-4d25-bd71-8ae80cc95a4e tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:34:26.257673 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-029ad8a5-0256-4d25-bd71-8ae80cc95a4e tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: 994c3400-0024-457d-88c7-e59b4053062c] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:34:26.264566 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-029ad8a5-0256-4d25-bd71-8ae80cc95a4e tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:34:26.265044 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-029ad8a5-0256-4d25-bd71-8ae80cc95a4e tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:34:26.265479 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-029ad8a5-0256-4d25-bd71-8ae80cc95a4e tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:34:26.266170 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-029ad8a5-0256-4d25-bd71-8ae80cc95a4e tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:34:26.266647 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-029ad8a5-0256-4d25-bd71-8ae80cc95a4e tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:34:26.267065 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-029ad8a5-0256-4d25-bd71-8ae80cc95a4e tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:34:26.442867 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-41e1cf34-a22b-4572-bb4a-a7aded4200f7 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd095ed814b9e47e08d6b5a4fd2901c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f2e0c002343d88ae25dc7bfb2fe10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:34:26.449783 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-029ad8a5-0256-4d25-bd71-8ae80cc95a4e tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d86f09c6304121be2021cb5c15e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ab544d0b547919794e3efb49ba0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:34:26.451584 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-41e1cf34-a22b-4572-bb4a-a7aded4200f7 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] 10.222.0.23 "GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698" status: 200 len: 1722 microversion: 2.1 time: 0.225773 Sep 09 16:34:26.452132 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 194/389] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:34:26 2022] GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698 => generated 1722 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:34:26.457670 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-029ad8a5-0256-4d25-bd71-8ae80cc95a4e tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/994c3400-0024-457d-88c7-e59b4053062c" status: 200 len: 1370 microversion: 2.1 time: 0.204937 Sep 09 16:34:26.458235 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 196/390] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:34:26 2022] GET /compute/v2.1/servers/994c3400-0024-457d-88c7-e59b4053062c => generated 1370 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:34:27.480328 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-93c4820a-360f-496c-8e4d-8a5331206c9d tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:34:27.480945 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-93c4820a-360f-496c-8e4d-8a5331206c9d tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] [instance: 9e761961-9c74-444c-bb4b-0b2f82a9d698] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:34:27.483801 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-a52b4f37-8bc1-4392-90b2-a4e18c871984 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:34:27.484409 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-a52b4f37-8bc1-4392-90b2-a4e18c871984 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: 994c3400-0024-457d-88c7-e59b4053062c] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:34:27.487556 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-93c4820a-360f-496c-8e4d-8a5331206c9d tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:34:27.488042 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-93c4820a-360f-496c-8e4d-8a5331206c9d tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:34:27.488477 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-93c4820a-360f-496c-8e4d-8a5331206c9d tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:34:27.489153 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-93c4820a-360f-496c-8e4d-8a5331206c9d tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:34:27.489606 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-93c4820a-360f-496c-8e4d-8a5331206c9d tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:34:27.490027 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-93c4820a-360f-496c-8e4d-8a5331206c9d tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:34:27.491048 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-a52b4f37-8bc1-4392-90b2-a4e18c871984 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:34:27.491527 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-a52b4f37-8bc1-4392-90b2-a4e18c871984 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:34:27.491963 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-a52b4f37-8bc1-4392-90b2-a4e18c871984 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:34:27.492647 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-a52b4f37-8bc1-4392-90b2-a4e18c871984 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:34:27.493101 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-a52b4f37-8bc1-4392-90b2-a4e18c871984 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:34:27.493524 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-a52b4f37-8bc1-4392-90b2-a4e18c871984 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:34:27.682712 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-93c4820a-360f-496c-8e4d-8a5331206c9d tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd095ed814b9e47e08d6b5a4fd2901c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f2e0c002343d88ae25dc7bfb2fe10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:34:27.685948 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-a52b4f37-8bc1-4392-90b2-a4e18c871984 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d86f09c6304121be2021cb5c15e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ab544d0b547919794e3efb49ba0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:34:27.691222 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-93c4820a-360f-496c-8e4d-8a5331206c9d tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] 10.222.0.23 "GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698" status: 200 len: 1699 microversion: 2.1 time: 0.216671 Sep 09 16:34:27.691797 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 195/391] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:34:27 2022] GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698 => generated 1699 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:34:27.694228 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-a52b4f37-8bc1-4392-90b2-a4e18c871984 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/994c3400-0024-457d-88c7-e59b4053062c" status: 200 len: 1370 microversion: 2.1 time: 0.214245 Sep 09 16:34:27.694832 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 197/392] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:34:27 2022] GET /compute/v2.1/servers/994c3400-0024-457d-88c7-e59b4053062c => generated 1370 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:34:27.713108 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-47d83846-58f5-43ac-bffc-6ea17c1edb16 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:34:27.719308 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-47d83846-58f5-43ac-bffc-6ea17c1edb16 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:34:27.719783 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-47d83846-58f5-43ac-bffc-6ea17c1edb16 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:34:27.720215 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-47d83846-58f5-43ac-bffc-6ea17c1edb16 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:34:27.743176 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-47d83846-58f5-43ac-bffc-6ea17c1edb16 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] [instance: 9e761961-9c74-444c-bb4b-0b2f82a9d698] Going to try to start instance {{(pid=127198) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 09 16:34:27.787081 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-47d83846-58f5-43ac-bffc-6ea17c1edb16 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] 10.222.0.23 "POST /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698/action" status: 202 len: 0 microversion: 2.1 time: 0.077531 Sep 09 16:34:27.787656 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 196/393] 10.222.0.23 () {60 vars in 1278 bytes} [Fri Sep 9 16:34:27 2022] POST /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 09 16:34:27.796859 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-b76367d4-edc9-4ca8-a559-1dfbe29aeee0 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:34:27.797697 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-b76367d4-edc9-4ca8-a559-1dfbe29aeee0 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] [instance: 9e761961-9c74-444c-bb4b-0b2f82a9d698] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:34:27.804117 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-b76367d4-edc9-4ca8-a559-1dfbe29aeee0 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:34:27.804684 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-b76367d4-edc9-4ca8-a559-1dfbe29aeee0 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:34:27.805212 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-b76367d4-edc9-4ca8-a559-1dfbe29aeee0 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:34:27.805981 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-b76367d4-edc9-4ca8-a559-1dfbe29aeee0 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:34:27.806570 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-b76367d4-edc9-4ca8-a559-1dfbe29aeee0 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:34:27.807182 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-b76367d4-edc9-4ca8-a559-1dfbe29aeee0 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:34:27.976975 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-b76367d4-edc9-4ca8-a559-1dfbe29aeee0 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd095ed814b9e47e08d6b5a4fd2901c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f2e0c002343d88ae25dc7bfb2fe10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:34:27.986173 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-b76367d4-edc9-4ca8-a559-1dfbe29aeee0 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] 10.222.0.23 "GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698" status: 200 len: 1708 microversion: 2.1 time: 0.194229 Sep 09 16:34:27.987590 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 198/394] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:34:27 2022] GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698 => generated 1708 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:34:28.258903 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [req-0fee28c1-27eb-45f2-b98b-0f798ccee74c req-623cd893-5b7d-4516-b1b5-59110a5bae29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "994c3400-0024-457d-88c7-e59b4053062c", "name": "network-vif-plugged", "status": "completed", "tag": "cd3987cc-b23d-4fa7-bf49-6afa802d4f4a"}]} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:34:28.268848 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-0fee28c1-27eb-45f2-b98b-0f798ccee74c req-623cd893-5b7d-4516-b1b5-59110a5bae29 service nova] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:34:28.269320 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-0fee28c1-27eb-45f2-b98b-0f798ccee74c req-623cd893-5b7d-4516-b1b5-59110a5bae29 service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:34:28.269908 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-0fee28c1-27eb-45f2-b98b-0f798ccee74c req-623cd893-5b7d-4516-b1b5-59110a5bae29 service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:34:28.282856 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.compute.server_external_events [req-0fee28c1-27eb-45f2-b98b-0f798ccee74c req-623cd893-5b7d-4516-b1b5-59110a5bae29 service nova] Creating event network-vif-plugged:cd3987cc-b23d-4fa7-bf49-6afa802d4f4a for instance 994c3400-0024-457d-88c7-e59b4053062c on hv-cinder-83124 Sep 09 16:34:28.288843 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [req-0fee28c1-27eb-45f2-b98b-0f798ccee74c req-623cd893-5b7d-4516-b1b5-59110a5bae29 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034206 Sep 09 16:34:28.289619 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 197/395] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Sep 9 16:34:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:34:28.721625 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-f366cd6e-1e54-4d62-8fbc-631e7a74ce30 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:34:28.722645 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-f366cd6e-1e54-4d62-8fbc-631e7a74ce30 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: 994c3400-0024-457d-88c7-e59b4053062c] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:34:28.731937 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f366cd6e-1e54-4d62-8fbc-631e7a74ce30 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:34:28.732436 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f366cd6e-1e54-4d62-8fbc-631e7a74ce30 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:34:28.732875 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f366cd6e-1e54-4d62-8fbc-631e7a74ce30 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:34:28.733563 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f366cd6e-1e54-4d62-8fbc-631e7a74ce30 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:34:28.734011 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f366cd6e-1e54-4d62-8fbc-631e7a74ce30 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:34:28.734457 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f366cd6e-1e54-4d62-8fbc-631e7a74ce30 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:34:28.878830 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-f366cd6e-1e54-4d62-8fbc-631e7a74ce30 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d86f09c6304121be2021cb5c15e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ab544d0b547919794e3efb49ba0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:34:28.886760 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-f366cd6e-1e54-4d62-8fbc-631e7a74ce30 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/994c3400-0024-457d-88c7-e59b4053062c" status: 200 len: 1370 microversion: 2.1 time: 0.171818 Sep 09 16:34:28.887354 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 199/396] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:34:28 2022] GET /compute/v2.1/servers/994c3400-0024-457d-88c7-e59b4053062c => generated 1370 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:34:29.013810 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-48c849c8-5703-4fe7-9d74-c5c56759358e tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:34:29.014728 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-48c849c8-5703-4fe7-9d74-c5c56759358e tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] [instance: 9e761961-9c74-444c-bb4b-0b2f82a9d698] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:34:29.022701 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-48c849c8-5703-4fe7-9d74-c5c56759358e tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:34:29.023328 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-48c849c8-5703-4fe7-9d74-c5c56759358e tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:34:29.023940 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-48c849c8-5703-4fe7-9d74-c5c56759358e tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:34:29.024802 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-48c849c8-5703-4fe7-9d74-c5c56759358e tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:34:29.025363 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-48c849c8-5703-4fe7-9d74-c5c56759358e tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:34:29.026015 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-48c849c8-5703-4fe7-9d74-c5c56759358e tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:34:29.150629 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell0:SELECT=2 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:34:29.169072 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-48c849c8-5703-4fe7-9d74-c5c56759358e tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd095ed814b9e47e08d6b5a4fd2901c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f2e0c002343d88ae25dc7bfb2fe10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:34:29.177721 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-48c849c8-5703-4fe7-9d74-c5c56759358e tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] 10.222.0.23 "GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698" status: 200 len: 1708 microversion: 2.1 time: 0.170656 Sep 09 16:34:29.178284 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 198/397] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:34:29 2022] GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698 => generated 1708 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:34:29.913572 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-04292532-a4e8-4a3e-9447-c38f0adf8848 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:34:29.914970 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-04292532-a4e8-4a3e-9447-c38f0adf8848 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: 994c3400-0024-457d-88c7-e59b4053062c] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:34:29.917470 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG dbcounter [-] [127196] Writing DB stats nova_cell0:SELECT=2 {{(pid=127196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:34:29.918798 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG dbcounter [-] [127196] Writing DB stats nova_cell0:SELECT=10 {{(pid=127196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:34:29.928912 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-04292532-a4e8-4a3e-9447-c38f0adf8848 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:34:29.929702 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-04292532-a4e8-4a3e-9447-c38f0adf8848 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:34:29.930407 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-04292532-a4e8-4a3e-9447-c38f0adf8848 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:34:29.931566 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-04292532-a4e8-4a3e-9447-c38f0adf8848 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:34:29.932321 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-04292532-a4e8-4a3e-9447-c38f0adf8848 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:34:29.932986 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-04292532-a4e8-4a3e-9447-c38f0adf8848 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:34:30.075200 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-04292532-a4e8-4a3e-9447-c38f0adf8848 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d86f09c6304121be2021cb5c15e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ab544d0b547919794e3efb49ba0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:34:30.083238 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-04292532-a4e8-4a3e-9447-c38f0adf8848 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/994c3400-0024-457d-88c7-e59b4053062c" status: 200 len: 1370 microversion: 2.1 time: 0.176309 Sep 09 16:34:30.083806 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 200/398] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:34:29 2022] GET /compute/v2.1/servers/994c3400-0024-457d-88c7-e59b4053062c => generated 1370 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:34:30.203696 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-97bc2ae2-7b29-4b8b-b151-9b8f50a98210 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:34:30.204289 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-97bc2ae2-7b29-4b8b-b151-9b8f50a98210 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] [instance: 9e761961-9c74-444c-bb4b-0b2f82a9d698] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:34:30.212103 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-97bc2ae2-7b29-4b8b-b151-9b8f50a98210 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:34:30.212666 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-97bc2ae2-7b29-4b8b-b151-9b8f50a98210 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:34:30.213164 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-97bc2ae2-7b29-4b8b-b151-9b8f50a98210 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:34:30.213962 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-97bc2ae2-7b29-4b8b-b151-9b8f50a98210 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:34:30.214456 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-97bc2ae2-7b29-4b8b-b151-9b8f50a98210 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:34:30.215008 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-97bc2ae2-7b29-4b8b-b151-9b8f50a98210 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:34:30.359581 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-97bc2ae2-7b29-4b8b-b151-9b8f50a98210 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd095ed814b9e47e08d6b5a4fd2901c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f2e0c002343d88ae25dc7bfb2fe10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:34:30.367872 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-97bc2ae2-7b29-4b8b-b151-9b8f50a98210 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] 10.222.0.23 "GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698" status: 200 len: 1712 microversion: 2.1 time: 0.169315 Sep 09 16:34:30.368513 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 199/399] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:34:30 2022] GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698 => generated 1712 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:34:31.110822 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-aba19e21-4b9a-4a70-a600-c956d74be264 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:34:31.111785 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-aba19e21-4b9a-4a70-a600-c956d74be264 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: 994c3400-0024-457d-88c7-e59b4053062c] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:34:31.121576 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-aba19e21-4b9a-4a70-a600-c956d74be264 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:34:31.122283 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-aba19e21-4b9a-4a70-a600-c956d74be264 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:34:31.122969 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-aba19e21-4b9a-4a70-a600-c956d74be264 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:34:31.123658 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-aba19e21-4b9a-4a70-a600-c956d74be264 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:34:31.124115 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-aba19e21-4b9a-4a70-a600-c956d74be264 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:34:31.124530 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-aba19e21-4b9a-4a70-a600-c956d74be264 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:34:31.268505 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-aba19e21-4b9a-4a70-a600-c956d74be264 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d86f09c6304121be2021cb5c15e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ab544d0b547919794e3efb49ba0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:34:31.277027 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-aba19e21-4b9a-4a70-a600-c956d74be264 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/994c3400-0024-457d-88c7-e59b4053062c" status: 200 len: 1370 microversion: 2.1 time: 0.172660 Sep 09 16:34:31.277616 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 201/400] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:34:31 2022] GET /compute/v2.1/servers/994c3400-0024-457d-88c7-e59b4053062c => generated 1370 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:34:32.300875 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-544cc4e3-174c-441d-833a-0476c8eaf3d0 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:34:32.302107 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-544cc4e3-174c-441d-833a-0476c8eaf3d0 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: 994c3400-0024-457d-88c7-e59b4053062c] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:34:32.308921 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-544cc4e3-174c-441d-833a-0476c8eaf3d0 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:34:32.309426 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-544cc4e3-174c-441d-833a-0476c8eaf3d0 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:34:32.309934 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-544cc4e3-174c-441d-833a-0476c8eaf3d0 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:34:32.311062 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-544cc4e3-174c-441d-833a-0476c8eaf3d0 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:34:32.311640 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-544cc4e3-174c-441d-833a-0476c8eaf3d0 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:34:32.312173 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-544cc4e3-174c-441d-833a-0476c8eaf3d0 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:34:32.445568 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-544cc4e3-174c-441d-833a-0476c8eaf3d0 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d86f09c6304121be2021cb5c15e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ab544d0b547919794e3efb49ba0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:34:32.455245 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-544cc4e3-174c-441d-833a-0476c8eaf3d0 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/994c3400-0024-457d-88c7-e59b4053062c" status: 200 len: 1565 microversion: 2.1 time: 0.158427 Sep 09 16:34:32.455828 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 200/401] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:34:32 2022] GET /compute/v2.1/servers/994c3400-0024-457d-88c7-e59b4053062c => generated 1565 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:34:32.477582 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-27f27500-9dff-412c-b87b-202e16b957ae tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:34:32.478099 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-27f27500-9dff-412c-b87b-202e16b957ae tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: 994c3400-0024-457d-88c7-e59b4053062c] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:34:32.484561 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-27f27500-9dff-412c-b87b-202e16b957ae tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:34:32.485036 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-27f27500-9dff-412c-b87b-202e16b957ae tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:34:32.485455 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-27f27500-9dff-412c-b87b-202e16b957ae tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:34:32.486384 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-27f27500-9dff-412c-b87b-202e16b957ae tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:34:32.486891 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-27f27500-9dff-412c-b87b-202e16b957ae tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:34:32.487290 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-27f27500-9dff-412c-b87b-202e16b957ae tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:34:32.567802 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-27f27500-9dff-412c-b87b-202e16b957ae tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/994c3400-0024-457d-88c7-e59b4053062c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094092 Sep 09 16:34:32.568387 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 202/402] 10.222.0.23 () {58 vars in 1275 bytes} [Fri Sep 9 16:34:32 2022] GET /compute/v2.1/servers/994c3400-0024-457d-88c7-e59b4053062c/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:34:33.531480 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [req-d7543eea-f41f-4a9e-b92a-fb50d259ae3f req-97f15fbf-ac11-4d03-8308-97bfbc717217 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "994c3400-0024-457d-88c7-e59b4053062c", "tag": "cd3987cc-b23d-4fa7-bf49-6afa802d4f4a"}]} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:34:33.541262 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-d7543eea-f41f-4a9e-b92a-fb50d259ae3f req-97f15fbf-ac11-4d03-8308-97bfbc717217 service nova] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:34:33.541732 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-d7543eea-f41f-4a9e-b92a-fb50d259ae3f req-97f15fbf-ac11-4d03-8308-97bfbc717217 service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:34:33.542159 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-d7543eea-f41f-4a9e-b92a-fb50d259ae3f req-97f15fbf-ac11-4d03-8308-97bfbc717217 service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:34:33.553488 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.compute.server_external_events [req-d7543eea-f41f-4a9e-b92a-fb50d259ae3f req-97f15fbf-ac11-4d03-8308-97bfbc717217 service nova] Creating event network-changed:cd3987cc-b23d-4fa7-bf49-6afa802d4f4a for instance 994c3400-0024-457d-88c7-e59b4053062c on hv-cinder-83124 Sep 09 16:34:33.558546 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [req-d7543eea-f41f-4a9e-b92a-fb50d259ae3f req-97f15fbf-ac11-4d03-8308-97bfbc717217 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030722 Sep 09 16:34:33.559327 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 201/403] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Sep 9 16:34:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:34:45.348829 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG dbcounter [-] [127196] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=4 {{(pid=127196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:34:45.350015 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG dbcounter [-] [127196] Writing DB stats nova_cell1:SELECT=40 {{(pid=127196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:34:45.357360 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-d0d233fe-60d0-42a2-8d16-516b2e635852 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:34:45.358260 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-d0d233fe-60d0-42a2-8d16-516b2e635852 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: 27b503a6-c023-49fb-b11a-37da810939cf] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:34:45.369872 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-d0d233fe-60d0-42a2-8d16-516b2e635852 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:34:45.370739 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-d0d233fe-60d0-42a2-8d16-516b2e635852 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:34:45.371430 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-d0d233fe-60d0-42a2-8d16-516b2e635852 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:34:45.372532 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-d0d233fe-60d0-42a2-8d16-516b2e635852 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:34:45.373267 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-d0d233fe-60d0-42a2-8d16-516b2e635852 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:34:45.373950 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-d0d233fe-60d0-42a2-8d16-516b2e635852 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:34:45.398386 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-d0d233fe-60d0-42a2-8d16-516b2e635852 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf/ips" status: 200 len: 152 microversion: 2.20 time: 0.052239 Sep 09 16:34:45.398960 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 203/404] 10.222.0.23 () {60 vars in 1289 bytes} [Fri Sep 9 16:34:45 2022] GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf/ips => generated 152 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 16:34:48.080376 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-a1f8e86a-da66-4f13-abed-08b0315fee01 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:34:48.080992 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-a1f8e86a-da66-4f13-abed-08b0315fee01 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: 27b503a6-c023-49fb-b11a-37da810939cf] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:34:48.088699 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_api:SELECT=23 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:34:48.089799 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:34:48.093015 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a1f8e86a-da66-4f13-abed-08b0315fee01 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:34:48.093655 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a1f8e86a-da66-4f13-abed-08b0315fee01 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:34:48.094361 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a1f8e86a-da66-4f13-abed-08b0315fee01 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:34:48.095481 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a1f8e86a-da66-4f13-abed-08b0315fee01 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:34:48.095941 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a1f8e86a-da66-4f13-abed-08b0315fee01 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:34:48.096351 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a1f8e86a-da66-4f13-abed-08b0315fee01 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:34:48.122061 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.objects.instance [None req-a1f8e86a-da66-4f13-abed-08b0315fee01 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lazy-loading 'flavor' on Instance uuid 27b503a6-c023-49fb-b11a-37da810939cf {{(pid=127198) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 16:34:48.322933 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-a1f8e86a-da66-4f13-abed-08b0315fee01 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "POST /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf/action" status: 202 len: 0 microversion: 2.20 time: 0.246730 Sep 09 16:34:48.323660 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 202/405] 10.222.0.23 () {62 vars in 1319 bytes} [Fri Sep 9 16:34:48 2022] POST /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf/action => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 09 16:34:48.332712 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-b59a0436-07d4-4e5c-879d-145a700f2b52 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:34:48.334113 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-b59a0436-07d4-4e5c-879d-145a700f2b52 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: 27b503a6-c023-49fb-b11a-37da810939cf] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:34:48.341191 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-b59a0436-07d4-4e5c-879d-145a700f2b52 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:34:48.341787 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-b59a0436-07d4-4e5c-879d-145a700f2b52 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:34:48.342728 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-b59a0436-07d4-4e5c-879d-145a700f2b52 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:34:48.343518 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-b59a0436-07d4-4e5c-879d-145a700f2b52 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:34:48.343969 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-b59a0436-07d4-4e5c-879d-145a700f2b52 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:34:48.344568 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-b59a0436-07d4-4e5c-879d-145a700f2b52 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:34:48.492408 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-b59a0436-07d4-4e5c-879d-145a700f2b52 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:34:48.504602 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-b59a0436-07d4-4e5c-879d-145a700f2b52 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:34:48.506909 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-b59a0436-07d4-4e5c-879d-145a700f2b52 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:34:48.508681 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-b59a0436-07d4-4e5c-879d-145a700f2b52 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf" status: 200 len: 1723 microversion: 2.20 time: 0.180240 Sep 09 16:34:48.509436 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 204/406] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Sep 9 16:34:48 2022] GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf => generated 1723 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 16:34:49.538668 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-b83c5c5e-b1f9-48c0-8b5a-c1a5aacfc5fc tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:34:49.539333 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-b83c5c5e-b1f9-48c0-8b5a-c1a5aacfc5fc tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: 27b503a6-c023-49fb-b11a-37da810939cf] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:34:49.546541 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b83c5c5e-b1f9-48c0-8b5a-c1a5aacfc5fc tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:34:49.547038 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b83c5c5e-b1f9-48c0-8b5a-c1a5aacfc5fc tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:34:49.547467 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b83c5c5e-b1f9-48c0-8b5a-c1a5aacfc5fc tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:34:49.548198 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b83c5c5e-b1f9-48c0-8b5a-c1a5aacfc5fc tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:34:49.548642 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b83c5c5e-b1f9-48c0-8b5a-c1a5aacfc5fc tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:34:49.549060 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b83c5c5e-b1f9-48c0-8b5a-c1a5aacfc5fc tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:34:49.695483 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-b83c5c5e-b1f9-48c0-8b5a-c1a5aacfc5fc tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:34:49.703997 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-b83c5c5e-b1f9-48c0-8b5a-c1a5aacfc5fc tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:34:49.705443 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-b83c5c5e-b1f9-48c0-8b5a-c1a5aacfc5fc tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:34:49.706678 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-b83c5c5e-b1f9-48c0-8b5a-c1a5aacfc5fc tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf" status: 200 len: 1723 microversion: 2.20 time: 0.172873 Sep 09 16:34:49.707245 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 203/407] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Sep 9 16:34:49 2022] GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 16:34:50.732436 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-f9a2c08a-8717-4df0-a8e6-4a085d2f565d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:34:50.732989 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-f9a2c08a-8717-4df0-a8e6-4a085d2f565d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: 27b503a6-c023-49fb-b11a-37da810939cf] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:34:50.739888 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f9a2c08a-8717-4df0-a8e6-4a085d2f565d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:34:50.740384 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f9a2c08a-8717-4df0-a8e6-4a085d2f565d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:34:50.740861 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f9a2c08a-8717-4df0-a8e6-4a085d2f565d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:34:50.741570 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f9a2c08a-8717-4df0-a8e6-4a085d2f565d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:34:50.742024 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f9a2c08a-8717-4df0-a8e6-4a085d2f565d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:34:50.742442 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f9a2c08a-8717-4df0-a8e6-4a085d2f565d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:34:50.879958 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-f9a2c08a-8717-4df0-a8e6-4a085d2f565d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:34:50.888531 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-f9a2c08a-8717-4df0-a8e6-4a085d2f565d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:34:50.890000 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-f9a2c08a-8717-4df0-a8e6-4a085d2f565d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:34:50.891172 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-f9a2c08a-8717-4df0-a8e6-4a085d2f565d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf" status: 200 len: 1723 microversion: 2.20 time: 0.162842 Sep 09 16:34:50.891729 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 205/408] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Sep 9 16:34:50 2022] GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 16:34:51.916708 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-a0508e9f-c193-45a1-a12f-500658be6956 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:34:51.917405 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-a0508e9f-c193-45a1-a12f-500658be6956 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: 27b503a6-c023-49fb-b11a-37da810939cf] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:34:51.924311 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a0508e9f-c193-45a1-a12f-500658be6956 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:34:51.924785 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a0508e9f-c193-45a1-a12f-500658be6956 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:34:51.925212 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a0508e9f-c193-45a1-a12f-500658be6956 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:34:51.925883 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a0508e9f-c193-45a1-a12f-500658be6956 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:34:51.926326 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a0508e9f-c193-45a1-a12f-500658be6956 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:34:51.926773 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a0508e9f-c193-45a1-a12f-500658be6956 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:34:52.060838 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-a0508e9f-c193-45a1-a12f-500658be6956 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:34:52.069943 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-a0508e9f-c193-45a1-a12f-500658be6956 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:34:52.071410 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-a0508e9f-c193-45a1-a12f-500658be6956 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:34:52.072579 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-a0508e9f-c193-45a1-a12f-500658be6956 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf" status: 200 len: 1723 microversion: 2.20 time: 0.159799 Sep 09 16:34:52.078114 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 204/409] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Sep 9 16:34:51 2022] GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 16:34:53.101639 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-e195b505-3fd7-47fd-90ae-4e85768022fa tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:34:53.102688 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-e195b505-3fd7-47fd-90ae-4e85768022fa tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: 27b503a6-c023-49fb-b11a-37da810939cf] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:34:53.110149 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e195b505-3fd7-47fd-90ae-4e85768022fa tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:34:53.110671 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e195b505-3fd7-47fd-90ae-4e85768022fa tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:34:53.111099 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e195b505-3fd7-47fd-90ae-4e85768022fa tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:34:53.111792 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e195b505-3fd7-47fd-90ae-4e85768022fa tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:34:53.112235 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e195b505-3fd7-47fd-90ae-4e85768022fa tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:34:53.112649 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e195b505-3fd7-47fd-90ae-4e85768022fa tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:34:53.251585 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-e195b505-3fd7-47fd-90ae-4e85768022fa tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:34:53.263982 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-e195b505-3fd7-47fd-90ae-4e85768022fa tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:34:53.266292 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-e195b505-3fd7-47fd-90ae-4e85768022fa tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:34:53.267886 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-e195b505-3fd7-47fd-90ae-4e85768022fa tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf" status: 200 len: 1723 microversion: 2.20 time: 0.172963 Sep 09 16:34:53.268506 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 206/410] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Sep 9 16:34:53 2022] GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 16:34:54.299757 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-0aef68d7-9b9d-4ebb-b13a-37e2a550b9ad tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:34:54.300619 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-0aef68d7-9b9d-4ebb-b13a-37e2a550b9ad tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: 27b503a6-c023-49fb-b11a-37da810939cf] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:34:54.311176 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0aef68d7-9b9d-4ebb-b13a-37e2a550b9ad tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:34:54.311971 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0aef68d7-9b9d-4ebb-b13a-37e2a550b9ad tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:34:54.312689 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0aef68d7-9b9d-4ebb-b13a-37e2a550b9ad tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:34:54.313822 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0aef68d7-9b9d-4ebb-b13a-37e2a550b9ad tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:34:54.314573 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0aef68d7-9b9d-4ebb-b13a-37e2a550b9ad tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:34:54.315374 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0aef68d7-9b9d-4ebb-b13a-37e2a550b9ad tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:34:54.455780 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-0aef68d7-9b9d-4ebb-b13a-37e2a550b9ad tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:34:54.468187 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-0aef68d7-9b9d-4ebb-b13a-37e2a550b9ad tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:34:54.470336 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-0aef68d7-9b9d-4ebb-b13a-37e2a550b9ad tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:34:54.472238 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-0aef68d7-9b9d-4ebb-b13a-37e2a550b9ad tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf" status: 200 len: 1723 microversion: 2.20 time: 0.179452 Sep 09 16:34:54.473011 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 205/411] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Sep 9 16:34:54 2022] GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf => generated 1723 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 16:34:55.502482 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-5bfdb9e5-72f4-40f7-b4bc-8f8cadc9805c tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:34:55.503114 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-5bfdb9e5-72f4-40f7-b4bc-8f8cadc9805c tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: 27b503a6-c023-49fb-b11a-37da810939cf] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:34:55.510425 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-5bfdb9e5-72f4-40f7-b4bc-8f8cadc9805c tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:34:55.510925 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-5bfdb9e5-72f4-40f7-b4bc-8f8cadc9805c tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:34:55.511377 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-5bfdb9e5-72f4-40f7-b4bc-8f8cadc9805c tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:34:55.512062 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-5bfdb9e5-72f4-40f7-b4bc-8f8cadc9805c tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:34:55.512531 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-5bfdb9e5-72f4-40f7-b4bc-8f8cadc9805c tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:34:55.512913 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-5bfdb9e5-72f4-40f7-b4bc-8f8cadc9805c tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:34:55.665239 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-5bfdb9e5-72f4-40f7-b4bc-8f8cadc9805c tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:34:55.677626 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-5bfdb9e5-72f4-40f7-b4bc-8f8cadc9805c tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:34:55.679900 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-5bfdb9e5-72f4-40f7-b4bc-8f8cadc9805c tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:34:55.681626 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-5bfdb9e5-72f4-40f7-b4bc-8f8cadc9805c tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf" status: 200 len: 1723 microversion: 2.20 time: 0.183386 Sep 09 16:34:55.682299 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 207/412] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Sep 9 16:34:55 2022] GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf => generated 1723 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 16:34:56.707596 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-143adfa8-699b-445a-aee3-2a86228e6e56 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:34:56.708223 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-143adfa8-699b-445a-aee3-2a86228e6e56 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: 27b503a6-c023-49fb-b11a-37da810939cf] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:34:56.714909 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-143adfa8-699b-445a-aee3-2a86228e6e56 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:34:56.715418 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-143adfa8-699b-445a-aee3-2a86228e6e56 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:34:56.715853 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-143adfa8-699b-445a-aee3-2a86228e6e56 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:34:56.716541 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-143adfa8-699b-445a-aee3-2a86228e6e56 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:34:56.716994 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-143adfa8-699b-445a-aee3-2a86228e6e56 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:34:56.717464 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-143adfa8-699b-445a-aee3-2a86228e6e56 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:34:56.853096 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-143adfa8-699b-445a-aee3-2a86228e6e56 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:34:56.861713 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-143adfa8-699b-445a-aee3-2a86228e6e56 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:34:56.863196 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-143adfa8-699b-445a-aee3-2a86228e6e56 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:34:56.864345 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-143adfa8-699b-445a-aee3-2a86228e6e56 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf" status: 200 len: 1723 microversion: 2.20 time: 0.160760 Sep 09 16:34:56.864904 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 206/413] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Sep 9 16:34:56 2022] GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 16:34:57.889709 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-637608a8-45d7-46c7-97c2-f7cd47fcc0cd tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:34:57.890323 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-637608a8-45d7-46c7-97c2-f7cd47fcc0cd tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: 27b503a6-c023-49fb-b11a-37da810939cf] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:34:57.897234 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-637608a8-45d7-46c7-97c2-f7cd47fcc0cd tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:34:57.897710 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-637608a8-45d7-46c7-97c2-f7cd47fcc0cd tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:34:57.898132 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-637608a8-45d7-46c7-97c2-f7cd47fcc0cd tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:34:57.898872 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-637608a8-45d7-46c7-97c2-f7cd47fcc0cd tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:34:57.899321 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-637608a8-45d7-46c7-97c2-f7cd47fcc0cd tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:34:57.899731 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-637608a8-45d7-46c7-97c2-f7cd47fcc0cd tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:34:58.046247 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-637608a8-45d7-46c7-97c2-f7cd47fcc0cd tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:34:58.058712 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-637608a8-45d7-46c7-97c2-f7cd47fcc0cd tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:34:58.061367 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-637608a8-45d7-46c7-97c2-f7cd47fcc0cd tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:34:58.062719 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-637608a8-45d7-46c7-97c2-f7cd47fcc0cd tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf" status: 200 len: 1723 microversion: 2.20 time: 0.176982 Sep 09 16:34:58.063449 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 208/414] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Sep 9 16:34:57 2022] GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 16:34:59.089644 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-f63bedbd-8354-4be3-b816-e766e0c5de85 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:34:59.090345 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-f63bedbd-8354-4be3-b816-e766e0c5de85 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: 27b503a6-c023-49fb-b11a-37da810939cf] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:34:59.097310 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f63bedbd-8354-4be3-b816-e766e0c5de85 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:34:59.097817 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f63bedbd-8354-4be3-b816-e766e0c5de85 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:34:59.098223 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f63bedbd-8354-4be3-b816-e766e0c5de85 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:34:59.098964 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f63bedbd-8354-4be3-b816-e766e0c5de85 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:34:59.099410 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f63bedbd-8354-4be3-b816-e766e0c5de85 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:34:59.099825 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f63bedbd-8354-4be3-b816-e766e0c5de85 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:34:59.236502 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-f63bedbd-8354-4be3-b816-e766e0c5de85 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:34:59.246740 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-f63bedbd-8354-4be3-b816-e766e0c5de85 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:34:59.248591 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-f63bedbd-8354-4be3-b816-e766e0c5de85 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:34:59.250006 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-f63bedbd-8354-4be3-b816-e766e0c5de85 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf" status: 200 len: 1723 microversion: 2.20 time: 0.164477 Sep 09 16:34:59.250596 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 207/415] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Sep 9 16:34:59 2022] GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 16:35:00.283473 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-e74ca12d-2f58-4c11-a0df-188aa251c517 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:35:00.284165 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-e74ca12d-2f58-4c11-a0df-188aa251c517 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: 27b503a6-c023-49fb-b11a-37da810939cf] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:35:00.293037 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e74ca12d-2f58-4c11-a0df-188aa251c517 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:00.293676 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e74ca12d-2f58-4c11-a0df-188aa251c517 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:00.294246 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e74ca12d-2f58-4c11-a0df-188aa251c517 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:00.295574 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e74ca12d-2f58-4c11-a0df-188aa251c517 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:00.296177 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e74ca12d-2f58-4c11-a0df-188aa251c517 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:00.296744 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e74ca12d-2f58-4c11-a0df-188aa251c517 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:00.432242 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-e74ca12d-2f58-4c11-a0df-188aa251c517 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:00.440716 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-e74ca12d-2f58-4c11-a0df-188aa251c517 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:00.442151 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-e74ca12d-2f58-4c11-a0df-188aa251c517 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:00.443338 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-e74ca12d-2f58-4c11-a0df-188aa251c517 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf" status: 200 len: 1723 microversion: 2.20 time: 0.166167 Sep 09 16:35:00.443906 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 209/416] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Sep 9 16:35:00 2022] GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 16:35:01.451698 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-af6f07bb-e524-455e-a0f6-a2337bee1ba5 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:35:01.452619 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-af6f07bb-e524-455e-a0f6-a2337bee1ba5 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] [instance: 0294b919-efa9-40c8-8b3d-d83e5ce0af54] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:35:01.460114 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-af6f07bb-e524-455e-a0f6-a2337bee1ba5 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:01.460594 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-af6f07bb-e524-455e-a0f6-a2337bee1ba5 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:01.461046 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-af6f07bb-e524-455e-a0f6-a2337bee1ba5 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:01.461699 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-af6f07bb-e524-455e-a0f6-a2337bee1ba5 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:01.462146 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-af6f07bb-e524-455e-a0f6-a2337bee1ba5 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:01.462591 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-af6f07bb-e524-455e-a0f6-a2337bee1ba5 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:01.477781 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-6357f135-5caf-4ea2-b909-2be20b0b2254 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:35:01.478387 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-6357f135-5caf-4ea2-b909-2be20b0b2254 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: 27b503a6-c023-49fb-b11a-37da810939cf] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:35:01.484883 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-6357f135-5caf-4ea2-b909-2be20b0b2254 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:01.485425 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-6357f135-5caf-4ea2-b909-2be20b0b2254 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:01.485851 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-6357f135-5caf-4ea2-b909-2be20b0b2254 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:01.486551 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-6357f135-5caf-4ea2-b909-2be20b0b2254 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:01.487027 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-6357f135-5caf-4ea2-b909-2be20b0b2254 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:01.487156 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-af6f07bb-e524-455e-a0f6-a2337bee1ba5 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] 10.222.0.23 "GET /compute/v2.1/servers/0294b919-efa9-40c8-8b3d-d83e5ce0af54/ips" status: 200 len: 151 microversion: 2.1 time: 0.041947 Sep 09 16:35:01.487442 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-6357f135-5caf-4ea2-b909-2be20b0b2254 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:01.487784 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 208/417] 10.222.0.23 () {58 vars in 1248 bytes} [Fri Sep 9 16:35:01 2022] GET /compute/v2.1/servers/0294b919-efa9-40c8-8b3d-d83e5ce0af54/ips => generated 151 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:35:01.499298 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-253f8756-8731-4faa-bc34-332462aab080 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ed9a13bd-a45c-4452-9cc0-f8ef353c3cee"}} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:35:01.501682 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-253f8756-8731-4faa-bc34-332462aab080 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] [instance: 0294b919-efa9-40c8-8b3d-d83e5ce0af54] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:35:01.507558 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-253f8756-8731-4faa-bc34-332462aab080 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:01.508036 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-253f8756-8731-4faa-bc34-332462aab080 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:01.508460 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-253f8756-8731-4faa-bc34-332462aab080 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:01.509135 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-253f8756-8731-4faa-bc34-332462aab080 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:01.509582 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-253f8756-8731-4faa-bc34-332462aab080 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:01.509993 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-253f8756-8731-4faa-bc34-332462aab080 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:01.591382 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.wsgi [None req-253f8756-8731-4faa-bc34-332462aab080 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] HTTP exception thrown: Invalid volume: volume ed9a13bd-a45c-4452-9cc0-f8ef353c3cee is already attached to instances: c453c474-644e-4e46-9d23-b2b87716f5d7 Sep 09 16:35:01.593141 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-253f8756-8731-4faa-bc34-332462aab080 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Request method failure captured: Sep 09 16:35:01.593141 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: request: POST /compute/v2.1/servers/0294b919-efa9-40c8-8b3d-d83e5ce0af54/os-volume_attachments HTTP/1.1 Sep 09 16:35:01.593141 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Accept: application/json Sep 09 16:35:01.593141 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Accept-Encoding: identity Sep 09 16:35:01.593141 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Connection: close Sep 09 16:35:01.593141 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Content-Length: 74 Sep 09 16:35:01.593141 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Content-Type: application/json Sep 09 16:35:01.593141 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Host: 10.222.0.23 Sep 09 16:35:01.593141 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Openstack-System-Scope: None Sep 09 16:35:01.593141 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: User-Agent: python-urllib3/1.26.12 Sep 09 16:35:01.593141 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Auth-Token: gAAAAABjG2p8X7ru_JB5hJR44VQ2gJJ5-pnimmT3rRqiF7PaDSUV6TptFJkJ5B7Brlh3RUo94RsnCU-lX7lENCapIWQjRtP9b5hcyxC2h1lMkUs_mIUD6GO84yl6hoSKhKDmYwez2Ale62nt_G9YgAJhsj7sSTM8MyBYvPk9Cs4OYzLEWXRgGoo Sep 09 16:35:01.593141 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Domain-Id: None Sep 09 16:35:01.593141 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Domain-Name: None Sep 09 16:35:01.593141 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Identity-Status: Confirmed Sep 09 16:35:01.593141 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Is-Admin-Project: True Sep 09 16:35:01.593141 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Project-Domain-Id: default Sep 09 16:35:01.593141 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Project-Domain-Name: Default Sep 09 16:35:01.593141 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Project-Id: e17967a941be4a04bbc180e2cf3a7a55 Sep 09 16:35:01.593141 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Project-Name: tempest-AttachVolumeNegativeTest-456905727 Sep 09 16:35:01.593141 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Role: member,reader Sep 09 16:35:01.593141 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Roles: member,reader Sep 09 16:35:01.594527 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e17967a941be4a04bbc180e2cf3a7a55"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e17967a941be4a04bbc180e2cf3a7a55"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e17967a941be4a04bbc180e2cf3a7a55"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e17967a941be4a04bbc180e2cf3a7a55"}]}] Sep 09 16:35:01.594527 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Tenant: tempest-AttachVolumeNegativeTest-456905727 Sep 09 16:35:01.594527 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Tenant-Id: e17967a941be4a04bbc180e2cf3a7a55 Sep 09 16:35:01.594527 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-456905727 Sep 09 16:35:01.594527 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User: tempest-AttachVolumeNegativeTest-456905727-project Sep 09 16:35:01.594527 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User-Domain-Id: default Sep 09 16:35:01.594527 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User-Domain-Name: Default Sep 09 16:35:01.594527 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User-Id: 53c0721dc18343b18993ff5af098841d Sep 09 16:35:01.594527 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User-Name: tempest-AttachVolumeNegativeTest-456905727-project Sep 09 16:35:01.594527 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Sep 09 16:35:01.594527 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: {"volumeAttachment": {"volumeId": "ed9a13bd-a45c-4452-9cc0-f8ef353c3cee"}} Sep 09 16:35:01.594527 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: method: > Sep 09 16:35:01.595269 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: exception: Invalid volume: volume ed9a13bd-a45c-4452-9cc0-f8ef353c3cee is already attached to instances: c453c474-644e-4e46-9d23-b2b87716f5d7 Sep 09 16:35:01.595269 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: action_args: {'server_id': '0294b919-efa9-40c8-8b3d-d83e5ce0af54', 'body': {'volumeAttachment': {'volumeId': 'ed9a13bd-a45c-4452-9cc0-f8ef353c3cee'}}} Sep 09 16:35:01.595269 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 16:35:01.595269 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:35:01.595269 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 09 16:35:01.595269 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 09 16:35:01.595269 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 09 16:35:01.595269 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 09 16:35:01.595269 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 09 16:35:01.595269 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 09 16:35:01.595269 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 09 16:35:01.595269 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 09 16:35:01.595269 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 09 16:35:01.595269 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 09 16:35:01.595269 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume ed9a13bd-a45c-4452-9cc0-f8ef353c3cee is already attached to instances: c453c474-644e-4e46-9d23-b2b87716f5d7 Sep 09 16:35:01.595269 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:35:01.595269 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 16:35:01.595269 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:35:01.595269 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:35:01.596813 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 16:35:01.596813 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 16:35:01.596813 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 16:35:01.596813 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 16:35:01.596813 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 16:35:01.596813 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 16:35:01.596813 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 09 16:35:01.596813 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 16:35:01.596813 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 09 16:35:01.596813 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 16:35:01.596813 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 09 16:35:01.596813 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 16:35:01.596813 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 09 16:35:01.596813 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 09 16:35:01.596813 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume ed9a13bd-a45c-4452-9cc0-f8ef353c3cee is already attached to instances: c453c474-644e-4e46-9d23-b2b87716f5d7 Sep 09 16:35:01.596813 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:35:01.596813 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 16:35:01.596813 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:35:01.596813 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:35:01.596813 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 16:35:01.598164 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 16:35:01.598164 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 16:35:01.598164 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 16:35:01.598164 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume ed9a13bd-a45c-4452-9cc0-f8ef353c3cee is already attached to instances: c453c474-644e-4e46-9d23-b2b87716f5d7 Sep 09 16:35:01.598164 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:35:01.598164 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-253f8756-8731-4faa-bc34-332462aab080 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Returning 400 to user: Invalid volume: volume ed9a13bd-a45c-4452-9cc0-f8ef353c3cee is already attached to instances: c453c474-644e-4e46-9d23-b2b87716f5d7 {{(pid=127198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 16:35:01.598164 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-253f8756-8731-4faa-bc34-332462aab080 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] 10.222.0.23 "POST /compute/v2.1/servers/0294b919-efa9-40c8-8b3d-d83e5ce0af54/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.099479 Sep 09 16:35:01.598164 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 209/418] 10.222.0.23 () {60 vars in 1323 bytes} [Fri Sep 9 16:35:01 2022] POST /compute/v2.1/servers/0294b919-efa9-40c8-8b3d-d83e5ce0af54/os-volume_attachments => generated 174 bytes in 101 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 09 16:35:01.603686 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-d8d1900e-0af1-41de-91da-d85fdd49b037 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:35:01.604173 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-d8d1900e-0af1-41de-91da-d85fdd49b037 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] [instance: 0294b919-efa9-40c8-8b3d-d83e5ce0af54] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:35:01.610982 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d8d1900e-0af1-41de-91da-d85fdd49b037 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:01.611457 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d8d1900e-0af1-41de-91da-d85fdd49b037 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:01.611882 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d8d1900e-0af1-41de-91da-d85fdd49b037 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:01.612566 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d8d1900e-0af1-41de-91da-d85fdd49b037 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:01.613011 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d8d1900e-0af1-41de-91da-d85fdd49b037 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:01.613431 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d8d1900e-0af1-41de-91da-d85fdd49b037 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:01.622342 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-6357f135-5caf-4ea2-b909-2be20b0b2254 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:01.631179 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-6357f135-5caf-4ea2-b909-2be20b0b2254 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:01.632618 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-6357f135-5caf-4ea2-b909-2be20b0b2254 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:01.633777 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-6357f135-5caf-4ea2-b909-2be20b0b2254 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf" status: 200 len: 1723 microversion: 2.20 time: 0.159987 Sep 09 16:35:01.634343 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 210/419] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Sep 9 16:35:01 2022] GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 16:35:01.637742 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-d8d1900e-0af1-41de-91da-d85fdd49b037 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] [instance: 0294b919-efa9-40c8-8b3d-d83e5ce0af54] Going to try to terminate instance {{(pid=127198) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 16:35:01.722592 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-d8d1900e-0af1-41de-91da-d85fdd49b037 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] 10.222.0.23 "DELETE /compute/v2.1/servers/0294b919-efa9-40c8-8b3d-d83e5ce0af54" status: 204 len: 0 microversion: 2.1 time: 0.122235 Sep 09 16:35:01.723542 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 210/420] 10.222.0.23 () {58 vars in 1239 bytes} [Fri Sep 9 16:35:01 2022] DELETE /compute/v2.1/servers/0294b919-efa9-40c8-8b3d-d83e5ce0af54 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 16:35:01.733196 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-81183da3-830a-48da-ac93-60f595a79a44 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:35:01.733804 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-81183da3-830a-48da-ac93-60f595a79a44 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] [instance: 0294b919-efa9-40c8-8b3d-d83e5ce0af54] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:35:01.739889 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-81183da3-830a-48da-ac93-60f595a79a44 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:01.740382 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-81183da3-830a-48da-ac93-60f595a79a44 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:01.740803 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-81183da3-830a-48da-ac93-60f595a79a44 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:01.741481 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-81183da3-830a-48da-ac93-60f595a79a44 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:01.741924 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-81183da3-830a-48da-ac93-60f595a79a44 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:01.742336 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-81183da3-830a-48da-ac93-60f595a79a44 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:01.878711 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-81183da3-830a-48da-ac93-60f595a79a44 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c0721dc18343b18993ff5af098841d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17967a941be4a04bbc180e2cf3a7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:01.886881 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-81183da3-830a-48da-ac93-60f595a79a44 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] 10.222.0.23 "GET /compute/v2.1/servers/0294b919-efa9-40c8-8b3d-d83e5ce0af54" status: 200 len: 1683 microversion: 2.1 time: 0.159085 Sep 09 16:35:01.887457 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 211/421] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:35:01 2022] GET /compute/v2.1/servers/0294b919-efa9-40c8-8b3d-d83e5ce0af54 => generated 1683 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:35:02.662386 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-1db63f5c-cf33-4bba-8e2f-f6c1d0932b6d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:35:02.663238 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-1db63f5c-cf33-4bba-8e2f-f6c1d0932b6d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: 27b503a6-c023-49fb-b11a-37da810939cf] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:35:02.671380 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1db63f5c-cf33-4bba-8e2f-f6c1d0932b6d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:02.671934 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1db63f5c-cf33-4bba-8e2f-f6c1d0932b6d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:02.672434 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1db63f5c-cf33-4bba-8e2f-f6c1d0932b6d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:02.673230 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1db63f5c-cf33-4bba-8e2f-f6c1d0932b6d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:02.673756 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1db63f5c-cf33-4bba-8e2f-f6c1d0932b6d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:02.674240 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1db63f5c-cf33-4bba-8e2f-f6c1d0932b6d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:02.813582 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-1db63f5c-cf33-4bba-8e2f-f6c1d0932b6d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:02.825758 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-1db63f5c-cf33-4bba-8e2f-f6c1d0932b6d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:02.827914 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-1db63f5c-cf33-4bba-8e2f-f6c1d0932b6d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:02.829211 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-1db63f5c-cf33-4bba-8e2f-f6c1d0932b6d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf" status: 200 len: 1723 microversion: 2.20 time: 0.172422 Sep 09 16:35:02.829953 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 211/422] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Sep 9 16:35:02 2022] GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 16:35:02.914690 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-a00b9dea-5c57-4f37-8b01-dce3bdac1013 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:35:02.915487 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-a00b9dea-5c57-4f37-8b01-dce3bdac1013 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] [instance: 0294b919-efa9-40c8-8b3d-d83e5ce0af54] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:35:02.925307 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-a00b9dea-5c57-4f37-8b01-dce3bdac1013 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:02.925789 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-a00b9dea-5c57-4f37-8b01-dce3bdac1013 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:02.926217 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-a00b9dea-5c57-4f37-8b01-dce3bdac1013 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:02.926969 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-a00b9dea-5c57-4f37-8b01-dce3bdac1013 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:02.927396 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-a00b9dea-5c57-4f37-8b01-dce3bdac1013 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:02.927845 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-a00b9dea-5c57-4f37-8b01-dce3bdac1013 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:03.066518 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-a00b9dea-5c57-4f37-8b01-dce3bdac1013 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c0721dc18343b18993ff5af098841d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17967a941be4a04bbc180e2cf3a7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:03.074854 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-a00b9dea-5c57-4f37-8b01-dce3bdac1013 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] 10.222.0.23 "GET /compute/v2.1/servers/0294b919-efa9-40c8-8b3d-d83e5ce0af54" status: 200 len: 1683 microversion: 2.1 time: 0.166831 Sep 09 16:35:03.075423 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 212/423] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:35:02 2022] GET /compute/v2.1/servers/0294b919-efa9-40c8-8b3d-d83e5ce0af54 => generated 1683 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:35:03.854100 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-eb02acaf-8091-42d1-bc00-919903072d8e tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:35:03.854760 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-eb02acaf-8091-42d1-bc00-919903072d8e tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: 27b503a6-c023-49fb-b11a-37da810939cf] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:35:03.861775 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-eb02acaf-8091-42d1-bc00-919903072d8e tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:03.862291 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-eb02acaf-8091-42d1-bc00-919903072d8e tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:03.862749 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-eb02acaf-8091-42d1-bc00-919903072d8e tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:03.863472 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-eb02acaf-8091-42d1-bc00-919903072d8e tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:03.863924 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-eb02acaf-8091-42d1-bc00-919903072d8e tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:03.864336 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-eb02acaf-8091-42d1-bc00-919903072d8e tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:03.995560 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-eb02acaf-8091-42d1-bc00-919903072d8e tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:04.003924 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-eb02acaf-8091-42d1-bc00-919903072d8e tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:04.005361 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-eb02acaf-8091-42d1-bc00-919903072d8e tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:04.006526 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-eb02acaf-8091-42d1-bc00-919903072d8e tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf" status: 200 len: 1723 microversion: 2.20 time: 0.156526 Sep 09 16:35:04.007081 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 212/424] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Sep 9 16:35:03 2022] GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 16:35:04.099813 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-b75022bf-e06a-48bc-8079-f544877bf786 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:35:04.100711 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-b75022bf-e06a-48bc-8079-f544877bf786 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] [instance: 0294b919-efa9-40c8-8b3d-d83e5ce0af54] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:35:04.110193 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-b75022bf-e06a-48bc-8079-f544877bf786 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:04.110193 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-b75022bf-e06a-48bc-8079-f544877bf786 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:04.110193 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-b75022bf-e06a-48bc-8079-f544877bf786 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:04.110193 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-b75022bf-e06a-48bc-8079-f544877bf786 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:04.110677 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-b75022bf-e06a-48bc-8079-f544877bf786 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:04.110677 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-b75022bf-e06a-48bc-8079-f544877bf786 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:04.257049 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-b75022bf-e06a-48bc-8079-f544877bf786 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c0721dc18343b18993ff5af098841d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17967a941be4a04bbc180e2cf3a7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:04.265574 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-b75022bf-e06a-48bc-8079-f544877bf786 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] 10.222.0.23 "GET /compute/v2.1/servers/0294b919-efa9-40c8-8b3d-d83e5ce0af54" status: 200 len: 1683 microversion: 2.1 time: 0.169722 Sep 09 16:35:04.266566 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 213/425] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:35:04 2022] GET /compute/v2.1/servers/0294b919-efa9-40c8-8b3d-d83e5ce0af54 => generated 1683 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:35:04.663404 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [req-caa7cd0d-9b26-4490-a9bf-630a59017799 req-b5f091df-b62e-46eb-aaff-5a922302a6da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0294b919-efa9-40c8-8b3d-d83e5ce0af54", "name": "network-vif-deleted", "tag": "14294f4c-5948-4136-a2cc-6ad6dfcab540"}]} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:35:04.673356 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-caa7cd0d-9b26-4490-a9bf-630a59017799 req-b5f091df-b62e-46eb-aaff-5a922302a6da service nova] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:04.673822 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-caa7cd0d-9b26-4490-a9bf-630a59017799 req-b5f091df-b62e-46eb-aaff-5a922302a6da service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:04.674245 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-caa7cd0d-9b26-4490-a9bf-630a59017799 req-b5f091df-b62e-46eb-aaff-5a922302a6da service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:04.686291 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.compute.server_external_events [req-caa7cd0d-9b26-4490-a9bf-630a59017799 req-b5f091df-b62e-46eb-aaff-5a922302a6da service nova] Creating event network-vif-deleted:14294f4c-5948-4136-a2cc-6ad6dfcab540 for instance 0294b919-efa9-40c8-8b3d-d83e5ce0af54 on hv-cinder-83124 Sep 09 16:35:04.696461 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [req-caa7cd0d-9b26-4490-a9bf-630a59017799 req-b5f091df-b62e-46eb-aaff-5a922302a6da service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036548 Sep 09 16:35:04.697137 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 213/426] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Sep 9 16:35:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:35:05.032467 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-3b1a7b70-6290-4ec8-ad46-dd5b54526788 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:35:05.033098 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-3b1a7b70-6290-4ec8-ad46-dd5b54526788 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: 27b503a6-c023-49fb-b11a-37da810939cf] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:35:05.039176 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-3b1a7b70-6290-4ec8-ad46-dd5b54526788 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:05.039644 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-3b1a7b70-6290-4ec8-ad46-dd5b54526788 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:05.040267 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-3b1a7b70-6290-4ec8-ad46-dd5b54526788 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:05.040936 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-3b1a7b70-6290-4ec8-ad46-dd5b54526788 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:05.041398 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-3b1a7b70-6290-4ec8-ad46-dd5b54526788 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:05.042008 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-3b1a7b70-6290-4ec8-ad46-dd5b54526788 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:05.182224 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-3b1a7b70-6290-4ec8-ad46-dd5b54526788 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:05.191781 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-3b1a7b70-6290-4ec8-ad46-dd5b54526788 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:05.192470 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-3b1a7b70-6290-4ec8-ad46-dd5b54526788 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:05.193620 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-3b1a7b70-6290-4ec8-ad46-dd5b54526788 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf" status: 200 len: 1744 microversion: 2.20 time: 0.165480 Sep 09 16:35:05.194398 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 214/427] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Sep 9 16:35:05 2022] GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf => generated 1744 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 16:35:05.290249 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-901d3e28-d3bb-43e3-98e4-06a2f08f026f tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:35:05.290983 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-901d3e28-d3bb-43e3-98e4-06a2f08f026f tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] [instance: 0294b919-efa9-40c8-8b3d-d83e5ce0af54] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:35:05.300567 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-901d3e28-d3bb-43e3-98e4-06a2f08f026f tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:05.301284 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-901d3e28-d3bb-43e3-98e4-06a2f08f026f tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:05.301942 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-901d3e28-d3bb-43e3-98e4-06a2f08f026f tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:05.303112 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-901d3e28-d3bb-43e3-98e4-06a2f08f026f tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:05.303757 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-901d3e28-d3bb-43e3-98e4-06a2f08f026f tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:05.304316 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-901d3e28-d3bb-43e3-98e4-06a2f08f026f tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:05.361848 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-901d3e28-d3bb-43e3-98e4-06a2f08f026f tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:05.362335 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-901d3e28-d3bb-43e3-98e4-06a2f08f026f tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:05.362967 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-901d3e28-d3bb-43e3-98e4-06a2f08f026f tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:05.363418 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.objects.instance [None req-901d3e28-d3bb-43e3-98e4-06a2f08f026f tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lazy-loading 'fault' on Instance uuid 0294b919-efa9-40c8-8b3d-d83e5ce0af54 {{(pid=127198) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 16:35:05.450116 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-901d3e28-d3bb-43e3-98e4-06a2f08f026f tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c0721dc18343b18993ff5af098841d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17967a941be4a04bbc180e2cf3a7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:05.458746 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-901d3e28-d3bb-43e3-98e4-06a2f08f026f tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] 10.222.0.23 "GET /compute/v2.1/servers/0294b919-efa9-40c8-8b3d-d83e5ce0af54" status: 200 len: 1332 microversion: 2.1 time: 0.173416 Sep 09 16:35:05.459943 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 214/428] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:35:05 2022] GET /compute/v2.1/servers/0294b919-efa9-40c8-8b3d-d83e5ce0af54 => generated 1332 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:35:06.219450 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-8ae2c7b8-08fc-4e89-89a0-e9764baac338 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:35:06.220123 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-8ae2c7b8-08fc-4e89-89a0-e9764baac338 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: 27b503a6-c023-49fb-b11a-37da810939cf] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:35:06.226950 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-8ae2c7b8-08fc-4e89-89a0-e9764baac338 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:06.227434 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-8ae2c7b8-08fc-4e89-89a0-e9764baac338 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:06.227895 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-8ae2c7b8-08fc-4e89-89a0-e9764baac338 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:06.228597 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-8ae2c7b8-08fc-4e89-89a0-e9764baac338 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:06.229047 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-8ae2c7b8-08fc-4e89-89a0-e9764baac338 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:06.229505 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-8ae2c7b8-08fc-4e89-89a0-e9764baac338 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:06.363914 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-8ae2c7b8-08fc-4e89-89a0-e9764baac338 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:06.374419 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-8ae2c7b8-08fc-4e89-89a0-e9764baac338 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:06.377350 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-8ae2c7b8-08fc-4e89-89a0-e9764baac338 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:06.378603 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-8ae2c7b8-08fc-4e89-89a0-e9764baac338 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf" status: 200 len: 1744 microversion: 2.20 time: 0.163207 Sep 09 16:35:06.385868 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 215/429] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Sep 9 16:35:06 2022] GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf => generated 1744 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 16:35:06.482232 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-933a2d36-b101-4f53-b83c-90581dc9f87d tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:35:06.483542 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-933a2d36-b101-4f53-b83c-90581dc9f87d tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] [instance: 0294b919-efa9-40c8-8b3d-d83e5ce0af54] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:35:06.490480 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-933a2d36-b101-4f53-b83c-90581dc9f87d tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:06.491001 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-933a2d36-b101-4f53-b83c-90581dc9f87d tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:06.491590 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-933a2d36-b101-4f53-b83c-90581dc9f87d tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:06.492287 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-933a2d36-b101-4f53-b83c-90581dc9f87d tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:06.492731 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-933a2d36-b101-4f53-b83c-90581dc9f87d tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:06.493142 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-933a2d36-b101-4f53-b83c-90581dc9f87d tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:06.507571 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.wsgi [None req-933a2d36-b101-4f53-b83c-90581dc9f87d tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] HTTP exception thrown: Instance 0294b919-efa9-40c8-8b3d-d83e5ce0af54 could not be found. Sep 09 16:35:06.509393 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-933a2d36-b101-4f53-b83c-90581dc9f87d tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Request method failure captured: Sep 09 16:35:06.509393 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: request: GET /compute/v2.1/servers/0294b919-efa9-40c8-8b3d-d83e5ce0af54 HTTP/1.1 Sep 09 16:35:06.509393 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Accept: application/json Sep 09 16:35:06.509393 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Accept-Encoding: identity Sep 09 16:35:06.509393 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Connection: close Sep 09 16:35:06.509393 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Content-Length: 0 Sep 09 16:35:06.509393 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Content-Type: application/json Sep 09 16:35:06.509393 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Host: 10.222.0.23 Sep 09 16:35:06.509393 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Openstack-System-Scope: None Sep 09 16:35:06.509393 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: User-Agent: python-urllib3/1.26.12 Sep 09 16:35:06.509393 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Auth-Token: gAAAAABjG2p8X7ru_JB5hJR44VQ2gJJ5-pnimmT3rRqiF7PaDSUV6TptFJkJ5B7Brlh3RUo94RsnCU-lX7lENCapIWQjRtP9b5hcyxC2h1lMkUs_mIUD6GO84yl6hoSKhKDmYwez2Ale62nt_G9YgAJhsj7sSTM8MyBYvPk9Cs4OYzLEWXRgGoo Sep 09 16:35:06.509393 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Domain-Id: None Sep 09 16:35:06.509393 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Domain-Name: None Sep 09 16:35:06.509393 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Identity-Status: Confirmed Sep 09 16:35:06.509393 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Is-Admin-Project: True Sep 09 16:35:06.509393 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Project-Domain-Id: default Sep 09 16:35:06.509393 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Project-Domain-Name: Default Sep 09 16:35:06.509393 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Project-Id: e17967a941be4a04bbc180e2cf3a7a55 Sep 09 16:35:06.509393 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Project-Name: tempest-AttachVolumeNegativeTest-456905727 Sep 09 16:35:06.509393 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Role: member,reader Sep 09 16:35:06.509393 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Roles: member,reader Sep 09 16:35:06.511008 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e17967a941be4a04bbc180e2cf3a7a55"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e17967a941be4a04bbc180e2cf3a7a55"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e17967a941be4a04bbc180e2cf3a7a55"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e17967a941be4a04bbc180e2cf3a7a55"}]}] Sep 09 16:35:06.511008 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Tenant: tempest-AttachVolumeNegativeTest-456905727 Sep 09 16:35:06.511008 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Tenant-Id: e17967a941be4a04bbc180e2cf3a7a55 Sep 09 16:35:06.511008 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-456905727 Sep 09 16:35:06.511008 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User: tempest-AttachVolumeNegativeTest-456905727-project Sep 09 16:35:06.511008 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User-Domain-Id: default Sep 09 16:35:06.511008 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User-Domain-Name: Default Sep 09 16:35:06.511008 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User-Id: 53c0721dc18343b18993ff5af098841d Sep 09 16:35:06.511008 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User-Name: tempest-AttachVolumeNegativeTest-456905727-project Sep 09 16:35:06.511008 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: method: > Sep 09 16:35:06.511008 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: exception: Instance 0294b919-efa9-40c8-8b3d-d83e5ce0af54 could not be found. Sep 09 16:35:06.511008 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: action_args: {'id': '0294b919-efa9-40c8-8b3d-d83e5ce0af54'} Sep 09 16:35:06.512309 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 16:35:06.512309 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:35:06.512309 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 16:35:06.512309 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 16:35:06.512309 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 16:35:06.512309 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 16:35:06.512309 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 16:35:06.512309 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 16:35:06.512309 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 16:35:06.512309 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 16:35:06.512309 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0294b919-efa9-40c8-8b3d-d83e5ce0af54 could not be found. Sep 09 16:35:06.512309 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:35:06.512309 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 16:35:06.512309 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:35:06.512309 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:35:06.512309 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 16:35:06.512309 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 16:35:06.512309 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 16:35:06.512309 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 16:35:06.512309 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 16:35:06.517723 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 16:35:06.517723 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 16:35:06.517723 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 16:35:06.517723 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 16:35:06.517723 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 16:35:06.517723 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 16:35:06.517723 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 16:35:06.517723 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0294b919-efa9-40c8-8b3d-d83e5ce0af54 could not be found. Sep 09 16:35:06.517723 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:35:06.517723 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 16:35:06.517723 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:35:06.517723 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:35:06.517723 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 16:35:06.517723 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 16:35:06.517723 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 16:35:06.517723 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 16:35:06.517723 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0294b919-efa9-40c8-8b3d-d83e5ce0af54 could not be found. Sep 09 16:35:06.517723 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:35:06.519358 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-933a2d36-b101-4f53-b83c-90581dc9f87d tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Returning 404 to user: Instance 0294b919-efa9-40c8-8b3d-d83e5ce0af54 could not be found. {{(pid=127198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 16:35:06.519358 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-933a2d36-b101-4f53-b83c-90581dc9f87d tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] 10.222.0.23 "GET /compute/v2.1/servers/0294b919-efa9-40c8-8b3d-d83e5ce0af54" status: 404 len: 111 microversion: 2.1 time: 0.032939 Sep 09 16:35:06.519358 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 215/430] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:35:06 2022] GET /compute/v2.1/servers/0294b919-efa9-40c8-8b3d-d83e5ce0af54 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 16:35:06.524986 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-6f57d79d-4c38-4dd2-9a25-a1384106e8b8 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Calling method '.version_select at 0x7f24fb7be820>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:35:06.555722 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-6f57d79d-4c38-4dd2-9a25-a1384106e8b8 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1800361580" status: 202 len: 0 microversion: 2.1 time: 0.034284 Sep 09 16:35:06.556373 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 216/431] 10.222.0.23 () {58 vars in 1221 bytes} [Fri Sep 9 16:35:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1800361580 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 16:35:07.280962 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-98d36ce6-828d-4ca3-a1d1-f682e177d0e5 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:35:07.281643 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-98d36ce6-828d-4ca3-a1d1-f682e177d0e5 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] [instance: c453c474-644e-4e46-9d23-b2b87716f5d7] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:35:07.290609 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-98d36ce6-828d-4ca3-a1d1-f682e177d0e5 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:07.291319 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-98d36ce6-828d-4ca3-a1d1-f682e177d0e5 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:07.291953 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-98d36ce6-828d-4ca3-a1d1-f682e177d0e5 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:07.292979 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-98d36ce6-828d-4ca3-a1d1-f682e177d0e5 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:07.293620 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-98d36ce6-828d-4ca3-a1d1-f682e177d0e5 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:07.294244 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-98d36ce6-828d-4ca3-a1d1-f682e177d0e5 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:07.324898 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:35:07.403946 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-5c2ae45c-9751-4fb5-9efa-eb78cf7cd6d7 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:35:07.404568 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-5c2ae45c-9751-4fb5-9efa-eb78cf7cd6d7 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: 27b503a6-c023-49fb-b11a-37da810939cf] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:35:07.411878 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-5c2ae45c-9751-4fb5-9efa-eb78cf7cd6d7 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:07.412361 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-5c2ae45c-9751-4fb5-9efa-eb78cf7cd6d7 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:07.412783 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-5c2ae45c-9751-4fb5-9efa-eb78cf7cd6d7 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:07.413484 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-5c2ae45c-9751-4fb5-9efa-eb78cf7cd6d7 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:07.413916 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-5c2ae45c-9751-4fb5-9efa-eb78cf7cd6d7 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:07.414326 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-5c2ae45c-9751-4fb5-9efa-eb78cf7cd6d7 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:07.421057 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.objects.instance [None req-98d36ce6-828d-4ca3-a1d1-f682e177d0e5 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lazy-loading 'services' on Instance uuid c453c474-644e-4e46-9d23-b2b87716f5d7 {{(pid=127198) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 16:35:07.536633 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-98d36ce6-828d-4ca3-a1d1-f682e177d0e5 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c453c474-644e-4e46-9d23-b2b87716f5d7/os-volume_attachments/ed9a13bd-a45c-4452-9cc0-f8ef353c3cee" status: 202 len: 0 microversion: 2.1 time: 0.261984 Sep 09 16:35:07.537565 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 216/432] 10.222.0.23 () {58 vars in 1416 bytes} [Fri Sep 9 16:35:07 2022] DELETE /compute/v2.1/servers/c453c474-644e-4e46-9d23-b2b87716f5d7/os-volume_attachments/ed9a13bd-a45c-4452-9cc0-f8ef353c3cee => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 16:35:07.546535 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-5c2ae45c-9751-4fb5-9efa-eb78cf7cd6d7 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:07.548301 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-52c80d9a-d2dd-4d0a-a4b1-b2f1c21be25d tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:35:07.550829 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-52c80d9a-d2dd-4d0a-a4b1-b2f1c21be25d tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] [instance: c453c474-644e-4e46-9d23-b2b87716f5d7] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:35:07.556139 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-5c2ae45c-9751-4fb5-9efa-eb78cf7cd6d7 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:07.557918 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-5c2ae45c-9751-4fb5-9efa-eb78cf7cd6d7 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:07.559364 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-5c2ae45c-9751-4fb5-9efa-eb78cf7cd6d7 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf" status: 200 len: 1744 microversion: 2.20 time: 0.159431 Sep 09 16:35:07.559949 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 217/433] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Sep 9 16:35:07 2022] GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf => generated 1744 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 16:35:07.563333 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-52c80d9a-d2dd-4d0a-a4b1-b2f1c21be25d tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:07.564592 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-52c80d9a-d2dd-4d0a-a4b1-b2f1c21be25d tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:07.565112 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-52c80d9a-d2dd-4d0a-a4b1-b2f1c21be25d tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:07.566227 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-52c80d9a-d2dd-4d0a-a4b1-b2f1c21be25d tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:07.566953 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-52c80d9a-d2dd-4d0a-a4b1-b2f1c21be25d tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:07.567449 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-52c80d9a-d2dd-4d0a-a4b1-b2f1c21be25d tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:07.598193 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-52c80d9a-d2dd-4d0a-a4b1-b2f1c21be25d tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] 10.222.0.23 "GET /compute/v2.1/servers/c453c474-644e-4e46-9d23-b2b87716f5d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056079 Sep 09 16:35:07.598806 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 217/434] 10.222.0.23 () {58 vars in 1302 bytes} [Fri Sep 9 16:35:07 2022] GET /compute/v2.1/servers/c453c474-644e-4e46-9d23-b2b87716f5d7/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:35:08.555672 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [req-d6171a97-101e-4340-b97e-37f7ab0b32d1 req-bbeb4764-a22b-4023-b0c4-1465e30b9310 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27b503a6-c023-49fb-b11a-37da810939cf", "name": "network-vif-plugged", "status": "completed", "tag": "56079a62-4748-409c-b913-eb3925499a09"}]} {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:35:08.565806 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [req-d6171a97-101e-4340-b97e-37f7ab0b32d1 req-bbeb4764-a22b-4023-b0c4-1465e30b9310 service nova] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:08.566283 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [req-d6171a97-101e-4340-b97e-37f7ab0b32d1 req-bbeb4764-a22b-4023-b0c4-1465e30b9310 service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:08.566749 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [req-d6171a97-101e-4340-b97e-37f7ab0b32d1 req-bbeb4764-a22b-4023-b0c4-1465e30b9310 service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:08.578675 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.compute.server_external_events [req-d6171a97-101e-4340-b97e-37f7ab0b32d1 req-bbeb4764-a22b-4023-b0c4-1465e30b9310 service nova] Creating event network-vif-plugged:56079a62-4748-409c-b913-eb3925499a09 for instance 27b503a6-c023-49fb-b11a-37da810939cf on hv-cinder-83124 Sep 09 16:35:08.583944 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [req-d6171a97-101e-4340-b97e-37f7ab0b32d1 req-bbeb4764-a22b-4023-b0c4-1465e30b9310 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031955 Sep 09 16:35:08.584701 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 218/435] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Sep 9 16:35:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:35:08.585227 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-d328e3bf-8290-4650-b312-283e6270e061 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:35:08.585826 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-d328e3bf-8290-4650-b312-283e6270e061 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: 27b503a6-c023-49fb-b11a-37da810939cf] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:35:08.592347 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d328e3bf-8290-4650-b312-283e6270e061 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:08.592821 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d328e3bf-8290-4650-b312-283e6270e061 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:08.593244 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d328e3bf-8290-4650-b312-283e6270e061 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:08.593926 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d328e3bf-8290-4650-b312-283e6270e061 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:08.594366 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d328e3bf-8290-4650-b312-283e6270e061 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:08.594910 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d328e3bf-8290-4650-b312-283e6270e061 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:08.612395 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-806d6d66-2a94-46c1-ae5d-2eeed22c1c1b tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:35:08.615319 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-806d6d66-2a94-46c1-ae5d-2eeed22c1c1b tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] [instance: c453c474-644e-4e46-9d23-b2b87716f5d7] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:35:08.621647 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-806d6d66-2a94-46c1-ae5d-2eeed22c1c1b tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:08.622078 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-806d6d66-2a94-46c1-ae5d-2eeed22c1c1b tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:08.622526 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-806d6d66-2a94-46c1-ae5d-2eeed22c1c1b tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:08.623245 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-806d6d66-2a94-46c1-ae5d-2eeed22c1c1b tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:08.623695 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-806d6d66-2a94-46c1-ae5d-2eeed22c1c1b tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:08.624118 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-806d6d66-2a94-46c1-ae5d-2eeed22c1c1b tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:08.654704 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-806d6d66-2a94-46c1-ae5d-2eeed22c1c1b tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] 10.222.0.23 "GET /compute/v2.1/servers/c453c474-644e-4e46-9d23-b2b87716f5d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047361 Sep 09 16:35:08.655381 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 219/436] 10.222.0.23 () {58 vars in 1302 bytes} [Fri Sep 9 16:35:08 2022] GET /compute/v2.1/servers/c453c474-644e-4e46-9d23-b2b87716f5d7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:35:08.737253 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-d328e3bf-8290-4650-b312-283e6270e061 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:08.745373 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-d328e3bf-8290-4650-b312-283e6270e061 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:08.746835 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-d328e3bf-8290-4650-b312-283e6270e061 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:08.747987 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-d328e3bf-8290-4650-b312-283e6270e061 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf" status: 200 len: 1744 microversion: 2.20 time: 0.166772 Sep 09 16:35:08.748543 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 218/437] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Sep 9 16:35:08 2022] GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf => generated 1744 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 16:35:09.671984 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-9f9c80d6-7bda-4f9a-ae14-81c4c699e6b0 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:35:09.675306 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-9f9c80d6-7bda-4f9a-ae14-81c4c699e6b0 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] [instance: c453c474-644e-4e46-9d23-b2b87716f5d7] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:35:09.681809 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-9f9c80d6-7bda-4f9a-ae14-81c4c699e6b0 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:09.682289 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-9f9c80d6-7bda-4f9a-ae14-81c4c699e6b0 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:09.682758 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-9f9c80d6-7bda-4f9a-ae14-81c4c699e6b0 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:09.683441 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-9f9c80d6-7bda-4f9a-ae14-81c4c699e6b0 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:09.683892 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-9f9c80d6-7bda-4f9a-ae14-81c4c699e6b0 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:09.684312 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-9f9c80d6-7bda-4f9a-ae14-81c4c699e6b0 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:09.713956 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-9f9c80d6-7bda-4f9a-ae14-81c4c699e6b0 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] 10.222.0.23 "GET /compute/v2.1/servers/c453c474-644e-4e46-9d23-b2b87716f5d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049241 Sep 09 16:35:09.714519 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 220/438] 10.222.0.23 () {58 vars in 1302 bytes} [Fri Sep 9 16:35:09 2022] GET /compute/v2.1/servers/c453c474-644e-4e46-9d23-b2b87716f5d7/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:35:09.776671 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-cf9ee625-e581-469c-94cc-f2c5ea2eaa9d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:35:09.777746 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-cf9ee625-e581-469c-94cc-f2c5ea2eaa9d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: 27b503a6-c023-49fb-b11a-37da810939cf] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:35:09.788621 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cf9ee625-e581-469c-94cc-f2c5ea2eaa9d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:09.789374 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cf9ee625-e581-469c-94cc-f2c5ea2eaa9d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:09.790119 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cf9ee625-e581-469c-94cc-f2c5ea2eaa9d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:09.791287 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cf9ee625-e581-469c-94cc-f2c5ea2eaa9d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:09.792026 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cf9ee625-e581-469c-94cc-f2c5ea2eaa9d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:09.792713 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cf9ee625-e581-469c-94cc-f2c5ea2eaa9d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:09.935081 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-cf9ee625-e581-469c-94cc-f2c5ea2eaa9d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:09.943473 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-cf9ee625-e581-469c-94cc-f2c5ea2eaa9d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:09.944900 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-cf9ee625-e581-469c-94cc-f2c5ea2eaa9d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:09.946081 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-cf9ee625-e581-469c-94cc-f2c5ea2eaa9d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf" status: 200 len: 1744 microversion: 2.20 time: 0.176020 Sep 09 16:35:09.946664 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 219/439] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Sep 9 16:35:09 2022] GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf => generated 1744 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 16:35:10.728709 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-f1375211-1ef5-4d1d-b8e1-8e67cb9db27d tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:35:10.730799 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-f1375211-1ef5-4d1d-b8e1-8e67cb9db27d tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] [instance: c453c474-644e-4e46-9d23-b2b87716f5d7] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:35:10.737608 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f1375211-1ef5-4d1d-b8e1-8e67cb9db27d tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:10.738425 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f1375211-1ef5-4d1d-b8e1-8e67cb9db27d tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:10.738920 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f1375211-1ef5-4d1d-b8e1-8e67cb9db27d tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:10.740203 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f1375211-1ef5-4d1d-b8e1-8e67cb9db27d tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:10.740992 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f1375211-1ef5-4d1d-b8e1-8e67cb9db27d tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:10.741415 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f1375211-1ef5-4d1d-b8e1-8e67cb9db27d tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:10.759344 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG dbcounter [-] [127196] Writing DB stats nova_cell1:SELECT=100 {{(pid=127196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:35:10.773126 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-f1375211-1ef5-4d1d-b8e1-8e67cb9db27d tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] 10.222.0.23 "GET /compute/v2.1/servers/c453c474-644e-4e46-9d23-b2b87716f5d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049987 Sep 09 16:35:10.773711 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 221/440] 10.222.0.23 () {58 vars in 1302 bytes} [Fri Sep 9 16:35:10 2022] GET /compute/v2.1/servers/c453c474-644e-4e46-9d23-b2b87716f5d7/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:35:10.973708 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-9117c867-0b9b-4e58-88aa-16fc45e25527 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:35:10.974670 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-9117c867-0b9b-4e58-88aa-16fc45e25527 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: 27b503a6-c023-49fb-b11a-37da810939cf] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:35:10.985599 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9117c867-0b9b-4e58-88aa-16fc45e25527 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:10.986293 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9117c867-0b9b-4e58-88aa-16fc45e25527 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:10.987089 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9117c867-0b9b-4e58-88aa-16fc45e25527 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:10.988218 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9117c867-0b9b-4e58-88aa-16fc45e25527 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:10.988971 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9117c867-0b9b-4e58-88aa-16fc45e25527 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:10.989658 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9117c867-0b9b-4e58-88aa-16fc45e25527 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:11.132765 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-9117c867-0b9b-4e58-88aa-16fc45e25527 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:11.140838 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-9117c867-0b9b-4e58-88aa-16fc45e25527 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:11.142270 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-9117c867-0b9b-4e58-88aa-16fc45e25527 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:11.143446 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-9117c867-0b9b-4e58-88aa-16fc45e25527 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf" status: 200 len: 1744 microversion: 2.20 time: 0.175748 Sep 09 16:35:11.143999 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 220/441] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Sep 9 16:35:10 2022] GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf => generated 1744 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 16:35:11.785832 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-bdc26a53-2ce6-4440-aaa2-292f7656b6cb tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:35:11.787993 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-bdc26a53-2ce6-4440-aaa2-292f7656b6cb tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] [instance: c453c474-644e-4e46-9d23-b2b87716f5d7] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:35:11.795042 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-bdc26a53-2ce6-4440-aaa2-292f7656b6cb tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:11.795540 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-bdc26a53-2ce6-4440-aaa2-292f7656b6cb tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:11.795973 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-bdc26a53-2ce6-4440-aaa2-292f7656b6cb tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:11.796663 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-bdc26a53-2ce6-4440-aaa2-292f7656b6cb tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:11.797168 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-bdc26a53-2ce6-4440-aaa2-292f7656b6cb tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:11.797587 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-bdc26a53-2ce6-4440-aaa2-292f7656b6cb tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:11.827383 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-bdc26a53-2ce6-4440-aaa2-292f7656b6cb tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] 10.222.0.23 "GET /compute/v2.1/servers/c453c474-644e-4e46-9d23-b2b87716f5d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045588 Sep 09 16:35:11.832012 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 222/442] 10.222.0.23 () {58 vars in 1302 bytes} [Fri Sep 9 16:35:11 2022] GET /compute/v2.1/servers/c453c474-644e-4e46-9d23-b2b87716f5d7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:35:12.169113 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-f4681509-232a-452e-b913-53eac7e37711 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:35:12.170093 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-f4681509-232a-452e-b913-53eac7e37711 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: 27b503a6-c023-49fb-b11a-37da810939cf] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:35:12.177406 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f4681509-232a-452e-b913-53eac7e37711 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:12.178017 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f4681509-232a-452e-b913-53eac7e37711 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:12.178449 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f4681509-232a-452e-b913-53eac7e37711 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:12.179176 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f4681509-232a-452e-b913-53eac7e37711 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:12.179619 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f4681509-232a-452e-b913-53eac7e37711 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:12.180029 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f4681509-232a-452e-b913-53eac7e37711 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:12.321997 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-f4681509-232a-452e-b913-53eac7e37711 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:12.330524 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-f4681509-232a-452e-b913-53eac7e37711 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:12.332122 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-f4681509-232a-452e-b913-53eac7e37711 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:12.333412 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-f4681509-232a-452e-b913-53eac7e37711 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf" status: 200 len: 1744 microversion: 2.20 time: 0.168485 Sep 09 16:35:12.333952 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 221/443] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Sep 9 16:35:12 2022] GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf => generated 1744 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 16:35:12.839262 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-c9a717dd-623e-4928-a333-a5e12486d6e6 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:35:12.841570 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-c9a717dd-623e-4928-a333-a5e12486d6e6 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] [instance: c453c474-644e-4e46-9d23-b2b87716f5d7] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:35:12.849057 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-c9a717dd-623e-4928-a333-a5e12486d6e6 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:12.849544 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-c9a717dd-623e-4928-a333-a5e12486d6e6 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:12.849974 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-c9a717dd-623e-4928-a333-a5e12486d6e6 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:12.850708 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-c9a717dd-623e-4928-a333-a5e12486d6e6 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:12.851347 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-c9a717dd-623e-4928-a333-a5e12486d6e6 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:12.851763 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-c9a717dd-623e-4928-a333-a5e12486d6e6 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:12.881983 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-c9a717dd-623e-4928-a333-a5e12486d6e6 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] 10.222.0.23 "GET /compute/v2.1/servers/c453c474-644e-4e46-9d23-b2b87716f5d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046798 Sep 09 16:35:12.882597 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 223/444] 10.222.0.23 () {58 vars in 1302 bytes} [Fri Sep 9 16:35:12 2022] GET /compute/v2.1/servers/c453c474-644e-4e46-9d23-b2b87716f5d7/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:35:13.367810 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-1e4e3279-8e5e-4f35-ad8d-bc7618af4405 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:35:13.369035 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-1e4e3279-8e5e-4f35-ad8d-bc7618af4405 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: 27b503a6-c023-49fb-b11a-37da810939cf] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:35:13.376497 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1e4e3279-8e5e-4f35-ad8d-bc7618af4405 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:13.377210 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1e4e3279-8e5e-4f35-ad8d-bc7618af4405 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:13.377797 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1e4e3279-8e5e-4f35-ad8d-bc7618af4405 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:13.378755 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1e4e3279-8e5e-4f35-ad8d-bc7618af4405 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:13.379387 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1e4e3279-8e5e-4f35-ad8d-bc7618af4405 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:13.380009 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1e4e3279-8e5e-4f35-ad8d-bc7618af4405 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:13.550767 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-1e4e3279-8e5e-4f35-ad8d-bc7618af4405 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:13.559484 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-1e4e3279-8e5e-4f35-ad8d-bc7618af4405 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:13.560934 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-1e4e3279-8e5e-4f35-ad8d-bc7618af4405 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:13.562105 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-1e4e3279-8e5e-4f35-ad8d-bc7618af4405 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf" status: 200 len: 1739 microversion: 2.20 time: 0.198895 Sep 09 16:35:13.562871 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 222/445] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Sep 9 16:35:13 2022] GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf => generated 1739 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 16:35:13.895822 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-f9f3120d-979f-42a9-a282-8c4ca2723f61 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:35:13.898257 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-f9f3120d-979f-42a9-a282-8c4ca2723f61 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] [instance: c453c474-644e-4e46-9d23-b2b87716f5d7] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:35:13.904685 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f9f3120d-979f-42a9-a282-8c4ca2723f61 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:13.905135 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f9f3120d-979f-42a9-a282-8c4ca2723f61 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:13.905699 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f9f3120d-979f-42a9-a282-8c4ca2723f61 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:13.906403 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f9f3120d-979f-42a9-a282-8c4ca2723f61 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:13.906871 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f9f3120d-979f-42a9-a282-8c4ca2723f61 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:13.907521 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f9f3120d-979f-42a9-a282-8c4ca2723f61 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:13.938270 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-f9f3120d-979f-42a9-a282-8c4ca2723f61 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] 10.222.0.23 "GET /compute/v2.1/servers/c453c474-644e-4e46-9d23-b2b87716f5d7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046625 Sep 09 16:35:13.938881 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 224/446] 10.222.0.23 () {58 vars in 1302 bytes} [Fri Sep 9 16:35:13 2022] GET /compute/v2.1/servers/c453c474-644e-4e46-9d23-b2b87716f5d7/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 09 16:35:14.012217 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-8b30d50d-1a41-4447-bf11-cf8c14775e8f tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:35:14.012709 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-8b30d50d-1a41-4447-bf11-cf8c14775e8f tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] [instance: c453c474-644e-4e46-9d23-b2b87716f5d7] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:35:14.019587 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8b30d50d-1a41-4447-bf11-cf8c14775e8f tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:14.020394 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8b30d50d-1a41-4447-bf11-cf8c14775e8f tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:14.021032 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8b30d50d-1a41-4447-bf11-cf8c14775e8f tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:14.021730 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8b30d50d-1a41-4447-bf11-cf8c14775e8f tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:14.022398 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8b30d50d-1a41-4447-bf11-cf8c14775e8f tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:14.022853 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8b30d50d-1a41-4447-bf11-cf8c14775e8f tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:14.051622 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-8b30d50d-1a41-4447-bf11-cf8c14775e8f tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] [instance: c453c474-644e-4e46-9d23-b2b87716f5d7] Going to try to terminate instance {{(pid=127198) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 16:35:14.159307 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-8b30d50d-1a41-4447-bf11-cf8c14775e8f tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c453c474-644e-4e46-9d23-b2b87716f5d7" status: 204 len: 0 microversion: 2.1 time: 0.149913 Sep 09 16:35:14.159749 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 223/447] 10.222.0.23 () {58 vars in 1239 bytes} [Fri Sep 9 16:35:14 2022] DELETE /compute/v2.1/servers/c453c474-644e-4e46-9d23-b2b87716f5d7 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 16:35:14.168804 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-9c853d05-e7cd-438c-b97b-26a0ffffaa4a tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:35:14.169850 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-9c853d05-e7cd-438c-b97b-26a0ffffaa4a tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] [instance: c453c474-644e-4e46-9d23-b2b87716f5d7] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:35:14.181631 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-9c853d05-e7cd-438c-b97b-26a0ffffaa4a tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:14.182157 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-9c853d05-e7cd-438c-b97b-26a0ffffaa4a tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:14.182646 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-9c853d05-e7cd-438c-b97b-26a0ffffaa4a tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:14.183530 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-9c853d05-e7cd-438c-b97b-26a0ffffaa4a tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:14.183981 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-9c853d05-e7cd-438c-b97b-26a0ffffaa4a tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:14.184400 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-9c853d05-e7cd-438c-b97b-26a0ffffaa4a tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:14.340026 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-9c853d05-e7cd-438c-b97b-26a0ffffaa4a tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c0721dc18343b18993ff5af098841d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17967a941be4a04bbc180e2cf3a7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:14.348035 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-9c853d05-e7cd-438c-b97b-26a0ffffaa4a tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] 10.222.0.23 "GET /compute/v2.1/servers/c453c474-644e-4e46-9d23-b2b87716f5d7" status: 200 len: 1681 microversion: 2.1 time: 0.183789 Sep 09 16:35:14.348716 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 225/448] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:35:14 2022] GET /compute/v2.1/servers/c453c474-644e-4e46-9d23-b2b87716f5d7 => generated 1681 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:35:14.593118 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-88fafcce-f02f-4897-9b87-21326027bc28 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:35:14.593861 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-88fafcce-f02f-4897-9b87-21326027bc28 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: 27b503a6-c023-49fb-b11a-37da810939cf] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:35:14.600747 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-88fafcce-f02f-4897-9b87-21326027bc28 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:14.601516 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-88fafcce-f02f-4897-9b87-21326027bc28 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:14.602211 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-88fafcce-f02f-4897-9b87-21326027bc28 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:14.603145 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-88fafcce-f02f-4897-9b87-21326027bc28 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:14.603634 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-88fafcce-f02f-4897-9b87-21326027bc28 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:14.604054 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-88fafcce-f02f-4897-9b87-21326027bc28 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:14.820788 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-88fafcce-f02f-4897-9b87-21326027bc28 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:14.830703 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-88fafcce-f02f-4897-9b87-21326027bc28 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:14.832434 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-88fafcce-f02f-4897-9b87-21326027bc28 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:14.833749 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-88fafcce-f02f-4897-9b87-21326027bc28 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf" status: 200 len: 1739 microversion: 2.20 time: 0.245328 Sep 09 16:35:14.834311 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 224/449] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Sep 9 16:35:14 2022] GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf => generated 1739 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 16:35:15.375654 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-92be3451-6529-46d6-944b-34f6e7986638 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:35:15.376283 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-92be3451-6529-46d6-944b-34f6e7986638 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] [instance: c453c474-644e-4e46-9d23-b2b87716f5d7] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:35:15.378664 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG dbcounter [-] [127196] Writing DB stats nova_api:SELECT=48,nova_api:DELETE=1 {{(pid=127196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:35:15.384145 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-92be3451-6529-46d6-944b-34f6e7986638 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:15.384839 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-92be3451-6529-46d6-944b-34f6e7986638 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:15.385427 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-92be3451-6529-46d6-944b-34f6e7986638 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:15.386286 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-92be3451-6529-46d6-944b-34f6e7986638 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:15.386915 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-92be3451-6529-46d6-944b-34f6e7986638 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:15.387490 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-92be3451-6529-46d6-944b-34f6e7986638 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:15.536047 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-92be3451-6529-46d6-944b-34f6e7986638 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c0721dc18343b18993ff5af098841d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17967a941be4a04bbc180e2cf3a7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:15.544075 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-92be3451-6529-46d6-944b-34f6e7986638 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] 10.222.0.23 "GET /compute/v2.1/servers/c453c474-644e-4e46-9d23-b2b87716f5d7" status: 200 len: 1681 microversion: 2.1 time: 0.172424 Sep 09 16:35:15.545361 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 226/450] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:35:15 2022] GET /compute/v2.1/servers/c453c474-644e-4e46-9d23-b2b87716f5d7 => generated 1681 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:35:15.861042 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-a5ba75c6-a01c-4974-83e1-8bd18baf3a1b tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:35:15.862478 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-a5ba75c6-a01c-4974-83e1-8bd18baf3a1b tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: 27b503a6-c023-49fb-b11a-37da810939cf] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:35:15.865267 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 09 16:35:15.865430 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Fri Sep 9 16:35:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf (ip 10.222.0.23) !!! Sep 09 16:35:15.872850 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a5ba75c6-a01c-4974-83e1-8bd18baf3a1b tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:15.873645 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a5ba75c6-a01c-4974-83e1-8bd18baf3a1b tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:15.874431 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a5ba75c6-a01c-4974-83e1-8bd18baf3a1b tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:15.875228 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a5ba75c6-a01c-4974-83e1-8bd18baf3a1b tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:15.875738 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a5ba75c6-a01c-4974-83e1-8bd18baf3a1b tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:15.876334 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a5ba75c6-a01c-4974-83e1-8bd18baf3a1b tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:16.017551 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-a5ba75c6-a01c-4974-83e1-8bd18baf3a1b tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:16.026573 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-a5ba75c6-a01c-4974-83e1-8bd18baf3a1b tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:16.028331 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-a5ba75c6-a01c-4974-83e1-8bd18baf3a1b tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:16.029676 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-a5ba75c6-a01c-4974-83e1-8bd18baf3a1b tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf" status: 200 len: 1739 microversion: 2.20 time: 0.172616 Sep 09 16:35:16.030842 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 225/451] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Sep 9 16:35:15 2022] GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf => generated 1739 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 16:35:16.570108 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-da7375c1-7673-496f-bbe9-c2bf3ed5c57f tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:35:16.571430 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-da7375c1-7673-496f-bbe9-c2bf3ed5c57f tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] [instance: c453c474-644e-4e46-9d23-b2b87716f5d7] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:35:16.579079 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-da7375c1-7673-496f-bbe9-c2bf3ed5c57f tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:16.579567 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-da7375c1-7673-496f-bbe9-c2bf3ed5c57f tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:16.580012 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-da7375c1-7673-496f-bbe9-c2bf3ed5c57f tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:16.580707 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-da7375c1-7673-496f-bbe9-c2bf3ed5c57f tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:16.581322 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-da7375c1-7673-496f-bbe9-c2bf3ed5c57f tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:16.581895 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-da7375c1-7673-496f-bbe9-c2bf3ed5c57f tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:16.739913 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-da7375c1-7673-496f-bbe9-c2bf3ed5c57f tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c0721dc18343b18993ff5af098841d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17967a941be4a04bbc180e2cf3a7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:16.748610 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-da7375c1-7673-496f-bbe9-c2bf3ed5c57f tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] 10.222.0.23 "GET /compute/v2.1/servers/c453c474-644e-4e46-9d23-b2b87716f5d7" status: 200 len: 1681 microversion: 2.1 time: 0.182696 Sep 09 16:35:16.750337 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 227/452] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:35:16 2022] GET /compute/v2.1/servers/c453c474-644e-4e46-9d23-b2b87716f5d7 => generated 1681 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:35:17.057516 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-1e0fdbc2-36a8-4aeb-9098-387d467207e9 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:35:17.058277 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-1e0fdbc2-36a8-4aeb-9098-387d467207e9 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: 27b503a6-c023-49fb-b11a-37da810939cf] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:35:17.069348 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1e0fdbc2-36a8-4aeb-9098-387d467207e9 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:17.070110 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1e0fdbc2-36a8-4aeb-9098-387d467207e9 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:17.070778 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1e0fdbc2-36a8-4aeb-9098-387d467207e9 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:17.071805 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1e0fdbc2-36a8-4aeb-9098-387d467207e9 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:17.072269 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1e0fdbc2-36a8-4aeb-9098-387d467207e9 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:17.072762 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1e0fdbc2-36a8-4aeb-9098-387d467207e9 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:17.232935 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-1e0fdbc2-36a8-4aeb-9098-387d467207e9 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:17.241824 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-1e0fdbc2-36a8-4aeb-9098-387d467207e9 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:17.243410 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-1e0fdbc2-36a8-4aeb-9098-387d467207e9 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:17.244707 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-1e0fdbc2-36a8-4aeb-9098-387d467207e9 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf" status: 200 len: 1739 microversion: 2.20 time: 0.192056 Sep 09 16:35:17.245271 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 226/453] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Sep 9 16:35:17 2022] GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf => generated 1739 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 16:35:17.774080 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-b2ca6025-5459-4f64-bd2c-1d3c5f73ff42 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:35:17.774724 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-b2ca6025-5459-4f64-bd2c-1d3c5f73ff42 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] [instance: c453c474-644e-4e46-9d23-b2b87716f5d7] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:35:17.782107 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-b2ca6025-5459-4f64-bd2c-1d3c5f73ff42 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:17.784763 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-b2ca6025-5459-4f64-bd2c-1d3c5f73ff42 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:17.785235 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-b2ca6025-5459-4f64-bd2c-1d3c5f73ff42 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:17.785957 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-b2ca6025-5459-4f64-bd2c-1d3c5f73ff42 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:17.786625 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-b2ca6025-5459-4f64-bd2c-1d3c5f73ff42 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:17.787201 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-b2ca6025-5459-4f64-bd2c-1d3c5f73ff42 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:17.982011 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-b2ca6025-5459-4f64-bd2c-1d3c5f73ff42 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c0721dc18343b18993ff5af098841d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17967a941be4a04bbc180e2cf3a7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:17.997776 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-b2ca6025-5459-4f64-bd2c-1d3c5f73ff42 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] 10.222.0.23 "GET /compute/v2.1/servers/c453c474-644e-4e46-9d23-b2b87716f5d7" status: 200 len: 1681 microversion: 2.1 time: 0.227969 Sep 09 16:35:18.011650 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 228/454] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:35:17 2022] GET /compute/v2.1/servers/c453c474-644e-4e46-9d23-b2b87716f5d7 => generated 1681 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:35:18.270643 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-a79ceb68-7204-4d0c-a3fd-6c685d7b63d0 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:35:18.271239 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-a79ceb68-7204-4d0c-a3fd-6c685d7b63d0 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: 27b503a6-c023-49fb-b11a-37da810939cf] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:35:18.274143 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=2 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:35:18.288657 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a79ceb68-7204-4d0c-a3fd-6c685d7b63d0 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:18.289150 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a79ceb68-7204-4d0c-a3fd-6c685d7b63d0 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:18.289930 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a79ceb68-7204-4d0c-a3fd-6c685d7b63d0 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:18.291078 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a79ceb68-7204-4d0c-a3fd-6c685d7b63d0 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:18.291734 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a79ceb68-7204-4d0c-a3fd-6c685d7b63d0 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:18.298367 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a79ceb68-7204-4d0c-a3fd-6c685d7b63d0 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:18.441823 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-a79ceb68-7204-4d0c-a3fd-6c685d7b63d0 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:18.450976 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-a79ceb68-7204-4d0c-a3fd-6c685d7b63d0 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:18.453211 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-a79ceb68-7204-4d0c-a3fd-6c685d7b63d0 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:18.454598 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-a79ceb68-7204-4d0c-a3fd-6c685d7b63d0 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf" status: 200 len: 1739 microversion: 2.20 time: 0.188003 Sep 09 16:35:18.472461 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 227/455] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Sep 9 16:35:18 2022] GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf => generated 1739 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 16:35:19.023778 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-0ce2ba76-88c5-4ebc-810f-680d112f7239 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:35:19.024351 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-0ce2ba76-88c5-4ebc-810f-680d112f7239 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] [instance: c453c474-644e-4e46-9d23-b2b87716f5d7] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:35:19.036555 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-0ce2ba76-88c5-4ebc-810f-680d112f7239 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:19.037070 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-0ce2ba76-88c5-4ebc-810f-680d112f7239 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:19.037517 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-0ce2ba76-88c5-4ebc-810f-680d112f7239 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:19.038268 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-0ce2ba76-88c5-4ebc-810f-680d112f7239 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:19.039024 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-0ce2ba76-88c5-4ebc-810f-680d112f7239 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:19.039459 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-0ce2ba76-88c5-4ebc-810f-680d112f7239 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:19.200640 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-0ce2ba76-88c5-4ebc-810f-680d112f7239 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c0721dc18343b18993ff5af098841d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17967a941be4a04bbc180e2cf3a7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:19.211927 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-0ce2ba76-88c5-4ebc-810f-680d112f7239 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] 10.222.0.23 "GET /compute/v2.1/servers/c453c474-644e-4e46-9d23-b2b87716f5d7" status: 200 len: 1613 microversion: 2.1 time: 0.192433 Sep 09 16:35:19.217999 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 229/456] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:35:19 2022] GET /compute/v2.1/servers/c453c474-644e-4e46-9d23-b2b87716f5d7 => generated 1613 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:35:19.364568 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [req-6165ebb5-9a9d-47a2-8618-a7da87bb5e17 req-dee4119f-d54c-4771-af06-71fc95b1680d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c453c474-644e-4e46-9d23-b2b87716f5d7", "name": "network-vif-deleted", "tag": "4976ea2e-5f69-46bc-9cfb-142523115ea4"}]} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:35:19.383585 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-6165ebb5-9a9d-47a2-8618-a7da87bb5e17 req-dee4119f-d54c-4771-af06-71fc95b1680d service nova] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:19.384412 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-6165ebb5-9a9d-47a2-8618-a7da87bb5e17 req-dee4119f-d54c-4771-af06-71fc95b1680d service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:19.385215 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-6165ebb5-9a9d-47a2-8618-a7da87bb5e17 req-dee4119f-d54c-4771-af06-71fc95b1680d service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:19.399132 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.compute.server_external_events [req-6165ebb5-9a9d-47a2-8618-a7da87bb5e17 req-dee4119f-d54c-4771-af06-71fc95b1680d service nova] Creating event network-vif-deleted:4976ea2e-5f69-46bc-9cfb-142523115ea4 for instance c453c474-644e-4e46-9d23-b2b87716f5d7 on hv-cinder-83124 Sep 09 16:35:19.406374 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [req-6165ebb5-9a9d-47a2-8618-a7da87bb5e17 req-dee4119f-d54c-4771-af06-71fc95b1680d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045489 Sep 09 16:35:19.408294 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 228/457] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Sep 9 16:35:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:35:19.480206 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-37705c2b-8a1d-40e9-aa23-0a4102c3d6f0 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:35:19.480824 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-37705c2b-8a1d-40e9-aa23-0a4102c3d6f0 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: 27b503a6-c023-49fb-b11a-37da810939cf] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:35:19.488204 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-37705c2b-8a1d-40e9-aa23-0a4102c3d6f0 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:19.494075 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-37705c2b-8a1d-40e9-aa23-0a4102c3d6f0 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:19.494543 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-37705c2b-8a1d-40e9-aa23-0a4102c3d6f0 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:19.495741 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-37705c2b-8a1d-40e9-aa23-0a4102c3d6f0 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:19.496179 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-37705c2b-8a1d-40e9-aa23-0a4102c3d6f0 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:19.496607 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-37705c2b-8a1d-40e9-aa23-0a4102c3d6f0 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:19.635769 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-1dd13cfa-5cb0-4468-a638-f146480d1959 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:35:19.636344 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-1dd13cfa-5cb0-4468-a638-f146480d1959 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] [instance: 9e761961-9c74-444c-bb4b-0b2f82a9d698] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:35:19.650535 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1dd13cfa-5cb0-4468-a638-f146480d1959 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:19.651320 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1dd13cfa-5cb0-4468-a638-f146480d1959 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:19.651915 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1dd13cfa-5cb0-4468-a638-f146480d1959 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:19.652782 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1dd13cfa-5cb0-4468-a638-f146480d1959 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:19.653383 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1dd13cfa-5cb0-4468-a638-f146480d1959 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:19.653952 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1dd13cfa-5cb0-4468-a638-f146480d1959 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:19.685400 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-37705c2b-8a1d-40e9-aa23-0a4102c3d6f0 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:19.697787 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-37705c2b-8a1d-40e9-aa23-0a4102c3d6f0 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:19.699683 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-37705c2b-8a1d-40e9-aa23-0a4102c3d6f0 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:19.701181 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-37705c2b-8a1d-40e9-aa23-0a4102c3d6f0 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf" status: 200 len: 1739 microversion: 2.20 time: 0.225362 Sep 09 16:35:19.702288 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 230/458] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Sep 9 16:35:19 2022] GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf => generated 1739 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 16:35:19.813384 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.objects.instance [None req-1dd13cfa-5cb0-4468-a638-f146480d1959 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lazy-loading 'services' on Instance uuid 9e761961-9c74-444c-bb4b-0b2f82a9d698 {{(pid=127198) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 16:35:19.946940 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-1dd13cfa-5cb0-4468-a638-f146480d1959 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] 10.222.0.23 "DELETE /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698/os-volume_attachments/2a73b452-5d0e-4987-a8c6-ebaa0f9add01" status: 202 len: 0 microversion: 2.1 time: 0.315523 Sep 09 16:35:19.950551 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 229/459] 10.222.0.23 () {58 vars in 1416 bytes} [Fri Sep 9 16:35:19 2022] DELETE /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698/os-volume_attachments/2a73b452-5d0e-4987-a8c6-ebaa0f9add01 => generated 0 bytes in 318 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 16:35:20.237992 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-78f000dc-ef42-46c6-bed8-94888b6d6580 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:35:20.238646 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-78f000dc-ef42-46c6-bed8-94888b6d6580 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] [instance: c453c474-644e-4e46-9d23-b2b87716f5d7] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:35:20.255462 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-78f000dc-ef42-46c6-bed8-94888b6d6580 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:20.255953 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-78f000dc-ef42-46c6-bed8-94888b6d6580 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:20.256382 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-78f000dc-ef42-46c6-bed8-94888b6d6580 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:20.257964 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-78f000dc-ef42-46c6-bed8-94888b6d6580 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:20.258415 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-78f000dc-ef42-46c6-bed8-94888b6d6580 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:20.259007 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-78f000dc-ef42-46c6-bed8-94888b6d6580 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:20.326307 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-78f000dc-ef42-46c6-bed8-94888b6d6580 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:20.326838 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-78f000dc-ef42-46c6-bed8-94888b6d6580 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:20.328752 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-78f000dc-ef42-46c6-bed8-94888b6d6580 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:20.329435 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.objects.instance [None req-78f000dc-ef42-46c6-bed8-94888b6d6580 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lazy-loading 'fault' on Instance uuid c453c474-644e-4e46-9d23-b2b87716f5d7 {{(pid=127196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 16:35:20.389398 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-78f000dc-ef42-46c6-bed8-94888b6d6580 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c0721dc18343b18993ff5af098841d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17967a941be4a04bbc180e2cf3a7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:20.399057 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-78f000dc-ef42-46c6-bed8-94888b6d6580 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] 10.222.0.23 "GET /compute/v2.1/servers/c453c474-644e-4e46-9d23-b2b87716f5d7" status: 200 len: 1330 microversion: 2.1 time: 0.165034 Sep 09 16:35:20.399685 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 231/460] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:35:20 2022] GET /compute/v2.1/servers/c453c474-644e-4e46-9d23-b2b87716f5d7 => generated 1330 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:35:20.503061 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-9721227f-f967-4e4f-9412-f62233b8ac85 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e1770aee-0b7f-44de-978d-9ab570bdb3ad"}} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:35:20.511280 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-9721227f-f967-4e4f-9412-f62233b8ac85 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: 994c3400-0024-457d-88c7-e59b4053062c] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:35:20.522570 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9721227f-f967-4e4f-9412-f62233b8ac85 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:20.523431 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9721227f-f967-4e4f-9412-f62233b8ac85 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:20.524206 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9721227f-f967-4e4f-9412-f62233b8ac85 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:20.525197 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9721227f-f967-4e4f-9412-f62233b8ac85 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:20.525907 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9721227f-f967-4e4f-9412-f62233b8ac85 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:20.526606 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9721227f-f967-4e4f-9412-f62233b8ac85 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:20.547721 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:35:20.729341 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-efd57e0a-1459-488b-a36c-a086ebd37edb tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:35:20.731451 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-efd57e0a-1459-488b-a36c-a086ebd37edb tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: 27b503a6-c023-49fb-b11a-37da810939cf] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:35:20.754611 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-efd57e0a-1459-488b-a36c-a086ebd37edb tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:20.755508 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-efd57e0a-1459-488b-a36c-a086ebd37edb tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:20.763326 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-efd57e0a-1459-488b-a36c-a086ebd37edb tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:20.765220 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-efd57e0a-1459-488b-a36c-a086ebd37edb tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:20.766046 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-efd57e0a-1459-488b-a36c-a086ebd37edb tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:20.766824 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-efd57e0a-1459-488b-a36c-a086ebd37edb tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:20.971833 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-9721227f-f967-4e4f-9412-f62233b8ac85 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "POST /compute/v2.1/servers/994c3400-0024-457d-88c7-e59b4053062c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.473437 Sep 09 16:35:20.990088 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 230/461] 10.222.0.23 () {60 vars in 1323 bytes} [Fri Sep 9 16:35:20 2022] POST /compute/v2.1/servers/994c3400-0024-457d-88c7-e59b4053062c/os-volume_attachments => generated 194 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:35:21.053820 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-efd57e0a-1459-488b-a36c-a086ebd37edb tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:21.071158 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-efd57e0a-1459-488b-a36c-a086ebd37edb tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:21.073495 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-efd57e0a-1459-488b-a36c-a086ebd37edb tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:21.075114 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-efd57e0a-1459-488b-a36c-a086ebd37edb tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf" status: 200 len: 1739 microversion: 2.20 time: 0.350755 Sep 09 16:35:21.076204 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 232/462] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Sep 9 16:35:20 2022] GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf => generated 1739 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 16:35:21.157617 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-bd6c6e24-bbcd-4e38-82fe-01e46b54bb45 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:35:21.172187 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-bd6c6e24-bbcd-4e38-82fe-01e46b54bb45 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:21.172982 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-bd6c6e24-bbcd-4e38-82fe-01e46b54bb45 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:21.173581 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-bd6c6e24-bbcd-4e38-82fe-01e46b54bb45 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:21.209566 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-bd6c6e24-bbcd-4e38-82fe-01e46b54bb45 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] [instance: 9e761961-9c74-444c-bb4b-0b2f82a9d698] Going to try to stop instance {{(pid=127198) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 09 16:35:21.286973 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-bd6c6e24-bbcd-4e38-82fe-01e46b54bb45 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] 10.222.0.23 "POST /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698/action" status: 202 len: 0 microversion: 2.1 time: 0.134138 Sep 09 16:35:21.292390 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 231/463] 10.222.0.23 () {60 vars in 1278 bytes} [Fri Sep 9 16:35:21 2022] POST /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698/action => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 16:35:21.302010 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-543c53a6-0c15-492b-8d76-848fec938b57 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:35:21.302858 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-543c53a6-0c15-492b-8d76-848fec938b57 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] [instance: 9e761961-9c74-444c-bb4b-0b2f82a9d698] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:35:21.314672 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-543c53a6-0c15-492b-8d76-848fec938b57 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:21.315170 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-543c53a6-0c15-492b-8d76-848fec938b57 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:21.315622 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-543c53a6-0c15-492b-8d76-848fec938b57 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:21.318655 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-543c53a6-0c15-492b-8d76-848fec938b57 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:21.319439 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-543c53a6-0c15-492b-8d76-848fec938b57 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:21.320043 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-543c53a6-0c15-492b-8d76-848fec938b57 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:21.429576 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-30b6bcf6-b220-4359-9bad-7d293e8b1be6 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:35:21.431486 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-30b6bcf6-b220-4359-9bad-7d293e8b1be6 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] [instance: c453c474-644e-4e46-9d23-b2b87716f5d7] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:35:21.439430 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-30b6bcf6-b220-4359-9bad-7d293e8b1be6 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:21.439941 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-30b6bcf6-b220-4359-9bad-7d293e8b1be6 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:21.440569 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-30b6bcf6-b220-4359-9bad-7d293e8b1be6 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:21.441703 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-30b6bcf6-b220-4359-9bad-7d293e8b1be6 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:21.442346 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-30b6bcf6-b220-4359-9bad-7d293e8b1be6 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:21.442938 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-30b6bcf6-b220-4359-9bad-7d293e8b1be6 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:21.458145 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.wsgi [None req-30b6bcf6-b220-4359-9bad-7d293e8b1be6 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] HTTP exception thrown: Instance c453c474-644e-4e46-9d23-b2b87716f5d7 could not be found. Sep 09 16:35:21.459819 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-30b6bcf6-b220-4359-9bad-7d293e8b1be6 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Request method failure captured: Sep 09 16:35:21.459819 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: request: GET /compute/v2.1/servers/c453c474-644e-4e46-9d23-b2b87716f5d7 HTTP/1.1 Sep 09 16:35:21.459819 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Accept: application/json Sep 09 16:35:21.459819 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Accept-Encoding: identity Sep 09 16:35:21.459819 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Connection: close Sep 09 16:35:21.459819 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Content-Length: 0 Sep 09 16:35:21.459819 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Content-Type: application/json Sep 09 16:35:21.459819 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Host: 10.222.0.23 Sep 09 16:35:21.459819 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Openstack-System-Scope: None Sep 09 16:35:21.459819 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: User-Agent: python-urllib3/1.26.12 Sep 09 16:35:21.459819 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Auth-Token: gAAAAABjG2p8X7ru_JB5hJR44VQ2gJJ5-pnimmT3rRqiF7PaDSUV6TptFJkJ5B7Brlh3RUo94RsnCU-lX7lENCapIWQjRtP9b5hcyxC2h1lMkUs_mIUD6GO84yl6hoSKhKDmYwez2Ale62nt_G9YgAJhsj7sSTM8MyBYvPk9Cs4OYzLEWXRgGoo Sep 09 16:35:21.459819 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Domain-Id: None Sep 09 16:35:21.459819 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Domain-Name: None Sep 09 16:35:21.459819 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Identity-Status: Confirmed Sep 09 16:35:21.459819 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Is-Admin-Project: True Sep 09 16:35:21.459819 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Project-Domain-Id: default Sep 09 16:35:21.459819 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Project-Domain-Name: Default Sep 09 16:35:21.459819 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Project-Id: e17967a941be4a04bbc180e2cf3a7a55 Sep 09 16:35:21.459819 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Project-Name: tempest-AttachVolumeNegativeTest-456905727 Sep 09 16:35:21.459819 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Role: member,reader Sep 09 16:35:21.459819 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Roles: member,reader Sep 09 16:35:21.461378 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e17967a941be4a04bbc180e2cf3a7a55"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e17967a941be4a04bbc180e2cf3a7a55"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e17967a941be4a04bbc180e2cf3a7a55"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e17967a941be4a04bbc180e2cf3a7a55"}]}] Sep 09 16:35:21.461378 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Tenant: tempest-AttachVolumeNegativeTest-456905727 Sep 09 16:35:21.461378 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Tenant-Id: e17967a941be4a04bbc180e2cf3a7a55 Sep 09 16:35:21.461378 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-456905727 Sep 09 16:35:21.461378 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User: tempest-AttachVolumeNegativeTest-456905727-project Sep 09 16:35:21.461378 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User-Domain-Id: default Sep 09 16:35:21.461378 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User-Domain-Name: Default Sep 09 16:35:21.461378 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User-Id: 53c0721dc18343b18993ff5af098841d Sep 09 16:35:21.461378 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User-Name: tempest-AttachVolumeNegativeTest-456905727-project Sep 09 16:35:21.461378 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: method: > Sep 09 16:35:21.461378 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: exception: Instance c453c474-644e-4e46-9d23-b2b87716f5d7 could not be found. Sep 09 16:35:21.461378 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: action_args: {'id': 'c453c474-644e-4e46-9d23-b2b87716f5d7'} Sep 09 16:35:21.462294 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 16:35:21.462294 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:35:21.462294 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 16:35:21.462294 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 16:35:21.462294 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 16:35:21.462294 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 16:35:21.462294 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 16:35:21.462294 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 16:35:21.462294 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 16:35:21.462294 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 16:35:21.462294 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c453c474-644e-4e46-9d23-b2b87716f5d7 could not be found. Sep 09 16:35:21.462294 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:35:21.462294 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 16:35:21.462294 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:35:21.462294 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:35:21.462294 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 16:35:21.462294 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 16:35:21.462294 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 16:35:21.462294 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 16:35:21.462294 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 16:35:21.463729 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 16:35:21.463729 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 16:35:21.463729 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 16:35:21.463729 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 16:35:21.463729 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 16:35:21.463729 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 16:35:21.463729 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 16:35:21.463729 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c453c474-644e-4e46-9d23-b2b87716f5d7 could not be found. Sep 09 16:35:21.463729 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:35:21.463729 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 16:35:21.463729 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:35:21.463729 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:35:21.463729 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 16:35:21.463729 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 16:35:21.463729 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 16:35:21.463729 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 16:35:21.463729 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c453c474-644e-4e46-9d23-b2b87716f5d7 could not be found. Sep 09 16:35:21.463729 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:35:21.465704 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-30b6bcf6-b220-4359-9bad-7d293e8b1be6 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Returning 404 to user: Instance c453c474-644e-4e46-9d23-b2b87716f5d7 could not be found. {{(pid=127198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 16:35:21.466891 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-30b6bcf6-b220-4359-9bad-7d293e8b1be6 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] 10.222.0.23 "GET /compute/v2.1/servers/c453c474-644e-4e46-9d23-b2b87716f5d7" status: 404 len: 111 microversion: 2.1 time: 0.044687 Sep 09 16:35:21.471230 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 232/464] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:35:21 2022] GET /compute/v2.1/servers/c453c474-644e-4e46-9d23-b2b87716f5d7 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 16:35:21.477065 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-628392b0-e024-48e9-80ce-e4bceadfe639 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Calling method '.version_select at 0x7f24fb8a1dc0>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:35:21.508445 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-628392b0-e024-48e9-80ce-e4bceadfe639 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-882262566" status: 202 len: 0 microversion: 2.1 time: 0.035851 Sep 09 16:35:21.509967 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 233/465] 10.222.0.23 () {58 vars in 1218 bytes} [Fri Sep 9 16:35:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-882262566 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 16:35:21.523963 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-543c53a6-0c15-492b-8d76-848fec938b57 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd095ed814b9e47e08d6b5a4fd2901c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f2e0c002343d88ae25dc7bfb2fe10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:21.532059 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-543c53a6-0c15-492b-8d76-848fec938b57 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] 10.222.0.23 "GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698" status: 200 len: 1676 microversion: 2.1 time: 0.235234 Sep 09 16:35:21.546670 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 233/466] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:35:21 2022] GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698 => generated 1676 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:35:22.106758 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-09a3a521-47f8-46f2-b137-c355d6dd4d28 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:35:22.108105 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-09a3a521-47f8-46f2-b137-c355d6dd4d28 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: 27b503a6-c023-49fb-b11a-37da810939cf] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:35:22.117708 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-09a3a521-47f8-46f2-b137-c355d6dd4d28 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:22.118418 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-09a3a521-47f8-46f2-b137-c355d6dd4d28 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:22.119012 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-09a3a521-47f8-46f2-b137-c355d6dd4d28 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:22.119889 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-09a3a521-47f8-46f2-b137-c355d6dd4d28 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:22.120633 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-09a3a521-47f8-46f2-b137-c355d6dd4d28 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:22.121258 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-09a3a521-47f8-46f2-b137-c355d6dd4d28 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:22.304402 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-09a3a521-47f8-46f2-b137-c355d6dd4d28 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:22.315103 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-09a3a521-47f8-46f2-b137-c355d6dd4d28 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:22.318294 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-09a3a521-47f8-46f2-b137-c355d6dd4d28 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:22.319839 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-09a3a521-47f8-46f2-b137-c355d6dd4d28 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf" status: 200 len: 1739 microversion: 2.20 time: 0.219751 Sep 09 16:35:22.320916 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 234/467] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Sep 9 16:35:22 2022] GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf => generated 1739 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 16:35:22.432113 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-652a4f8a-00a7-409e-89fd-ab131c6a6d1a tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Action: 'create', calling method: .version_select at 0x7f24fb9b59d0>, body: {"keypair": {"name": "tempest-keypair-2067039022", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB5BgiQFLb6qsxyhWmKuBXm73qUlAoqWl7g1F6RpiqxskdBsnPtJDuxigfBiguut3dhSB2iizsNPviulcotMKprk/NL1/hTERJ6OsbplRpTi6lXG/MctYKMhUAUcfTbkJw=="}} {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:35:22.450951 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.quota [None req-652a4f8a-00a7-409e-89fd-ab131c6a6d1a tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Getting quotas for project e17967a941be4a04bbc180e2cf3a7a55. Resources: {'key_pairs'} {{(pid=127196) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 16:35:22.455161 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.quota [None req-652a4f8a-00a7-409e-89fd-ab131c6a6d1a tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Getting quotas for user 53c0721dc18343b18993ff5af098841d and project e17967a941be4a04bbc180e2cf3a7a55. Resources: {'key_pairs'} {{(pid=127196) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 16:35:22.490767 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-652a4f8a-00a7-409e-89fd-ab131c6a6d1a tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.065731 Sep 09 16:35:22.498163 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 234/468] 10.222.0.23 () {60 vars in 1159 bytes} [Fri Sep 9 16:35:22 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:35:22.562765 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-8fd2c54c-877b-4ae3-88bc-91f0911720f6 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:35:22.563453 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-8fd2c54c-877b-4ae3-88bc-91f0911720f6 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] [instance: 9e761961-9c74-444c-bb4b-0b2f82a9d698] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:35:22.571001 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8fd2c54c-877b-4ae3-88bc-91f0911720f6 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:22.571487 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8fd2c54c-877b-4ae3-88bc-91f0911720f6 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:22.571939 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8fd2c54c-877b-4ae3-88bc-91f0911720f6 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:22.572647 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8fd2c54c-877b-4ae3-88bc-91f0911720f6 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:22.573099 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8fd2c54c-877b-4ae3-88bc-91f0911720f6 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:22.573521 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8fd2c54c-877b-4ae3-88bc-91f0911720f6 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:22.803158 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-8fd2c54c-877b-4ae3-88bc-91f0911720f6 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd095ed814b9e47e08d6b5a4fd2901c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f2e0c002343d88ae25dc7bfb2fe10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:22.816046 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-8fd2c54c-877b-4ae3-88bc-91f0911720f6 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] 10.222.0.23 "GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698" status: 200 len: 1676 microversion: 2.1 time: 0.257078 Sep 09 16:35:22.830534 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 235/469] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:35:22 2022] GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698 => generated 1676 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:35:23.345900 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-f9a4bd3f-0461-422e-827b-d11da3175114 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:35:23.346713 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-f9a4bd3f-0461-422e-827b-d11da3175114 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: 27b503a6-c023-49fb-b11a-37da810939cf] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:35:23.362198 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f9a4bd3f-0461-422e-827b-d11da3175114 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:23.363647 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f9a4bd3f-0461-422e-827b-d11da3175114 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:23.368407 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f9a4bd3f-0461-422e-827b-d11da3175114 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:23.369257 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f9a4bd3f-0461-422e-827b-d11da3175114 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:23.369773 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f9a4bd3f-0461-422e-827b-d11da3175114 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:23.370264 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f9a4bd3f-0461-422e-827b-d11da3175114 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:23.608868 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-f9a4bd3f-0461-422e-827b-d11da3175114 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:23.624204 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-f9a4bd3f-0461-422e-827b-d11da3175114 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:23.638313 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-f9a4bd3f-0461-422e-827b-d11da3175114 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:23.640705 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-f9a4bd3f-0461-422e-827b-d11da3175114 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf" status: 200 len: 1739 microversion: 2.20 time: 0.298859 Sep 09 16:35:23.641613 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 235/470] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Sep 9 16:35:23 2022] GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf => generated 1739 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 16:35:23.843985 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-8b908d6d-550d-4471-b441-b7ed07a3f92a tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:35:23.845191 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-8b908d6d-550d-4471-b441-b7ed07a3f92a tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] [instance: 9e761961-9c74-444c-bb4b-0b2f82a9d698] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:35:23.858887 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8b908d6d-550d-4471-b441-b7ed07a3f92a tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:23.859688 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8b908d6d-550d-4471-b441-b7ed07a3f92a tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:23.866574 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8b908d6d-550d-4471-b441-b7ed07a3f92a tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:23.869971 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8b908d6d-550d-4471-b441-b7ed07a3f92a tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:23.870637 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8b908d6d-550d-4471-b441-b7ed07a3f92a tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:23.871237 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8b908d6d-550d-4471-b441-b7ed07a3f92a tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:24.466973 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-8b908d6d-550d-4471-b441-b7ed07a3f92a tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd095ed814b9e47e08d6b5a4fd2901c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f2e0c002343d88ae25dc7bfb2fe10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:24.484139 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-8b908d6d-550d-4471-b441-b7ed07a3f92a tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] 10.222.0.23 "GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698" status: 200 len: 1676 microversion: 2.1 time: 0.643466 Sep 09 16:35:24.485652 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 236/471] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:35:23 2022] GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698 => generated 1676 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:35:24.668473 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-fbfd6ae9-8d80-43da-b5fb-7031dddc657c tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:35:24.670776 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-fbfd6ae9-8d80-43da-b5fb-7031dddc657c tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: 27b503a6-c023-49fb-b11a-37da810939cf] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:35:24.679186 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-fbfd6ae9-8d80-43da-b5fb-7031dddc657c tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:24.679979 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-fbfd6ae9-8d80-43da-b5fb-7031dddc657c tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:24.680624 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-fbfd6ae9-8d80-43da-b5fb-7031dddc657c tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:24.681651 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-fbfd6ae9-8d80-43da-b5fb-7031dddc657c tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:24.682619 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-fbfd6ae9-8d80-43da-b5fb-7031dddc657c tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:24.683258 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-fbfd6ae9-8d80-43da-b5fb-7031dddc657c tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:24.955759 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-fbfd6ae9-8d80-43da-b5fb-7031dddc657c tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:24.968816 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-fbfd6ae9-8d80-43da-b5fb-7031dddc657c tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:24.982429 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-fbfd6ae9-8d80-43da-b5fb-7031dddc657c tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:24.984492 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-fbfd6ae9-8d80-43da-b5fb-7031dddc657c tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf" status: 200 len: 1739 microversion: 2.20 time: 0.321068 Sep 09 16:35:24.985296 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 236/472] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Sep 9 16:35:24 2022] GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf => generated 1739 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 16:35:25.128534 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-5225aa98-6fd7-4431-ac9d-8776053de9d8 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2126494718", "imageRef": "0b1ba34f-2223-497a-9a18-c2ad8d398aae", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5831de5e-0ff3-4415-b956-35183f0be5e2"}], "security_groups": [{"name": "tempest-securitygroup--1335471711"}], "key_name": "tempest-keypair-2067039022", "user_data": "}} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:35:25.236125 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.network.neutron [None req-5225aa98-6fd7-4431-ac9d-8776053de9d8 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] validate_networks() for [('5831de5e-0ff3-4415-b956-35183f0be5e2', None, None, None, None, None)] {{(pid=127198) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 16:35:25.518661 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-d4099bba-8587-4e58-b952-ec13858cb2ab tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:35:25.519739 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-d4099bba-8587-4e58-b952-ec13858cb2ab tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] [instance: 9e761961-9c74-444c-bb4b-0b2f82a9d698] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:35:25.529147 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-d4099bba-8587-4e58-b952-ec13858cb2ab tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:25.529927 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-d4099bba-8587-4e58-b952-ec13858cb2ab tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:25.530687 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-d4099bba-8587-4e58-b952-ec13858cb2ab tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:25.531626 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-d4099bba-8587-4e58-b952-ec13858cb2ab tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:25.532165 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-d4099bba-8587-4e58-b952-ec13858cb2ab tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:25.532940 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-d4099bba-8587-4e58-b952-ec13858cb2ab tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:25.698223 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-5225aa98-6fd7-4431-ac9d-8776053de9d8 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Flavor limits 0:0:0 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 16:35:25.698807 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-5225aa98-6fd7-4431-ac9d-8776053de9d8 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Image limits 0:0:0 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 16:35:25.699354 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-5225aa98-6fd7-4431-ac9d-8776053de9d8 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Flavor pref 0:0:0 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 16:35:25.699825 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-5225aa98-6fd7-4431-ac9d-8776053de9d8 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Image pref 0:0:0 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 16:35:25.700310 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-5225aa98-6fd7-4431-ac9d-8776053de9d8 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 16:35:25.720059 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5225aa98-6fd7-4431-ac9d-8776053de9d8 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:25.720683 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5225aa98-6fd7-4431-ac9d-8776053de9d8 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:25.721196 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5225aa98-6fd7-4431-ac9d-8776053de9d8 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:25.722006 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5225aa98-6fd7-4431-ac9d-8776053de9d8 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:25.722547 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5225aa98-6fd7-4431-ac9d-8776053de9d8 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:25.723135 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5225aa98-6fd7-4431-ac9d-8776053de9d8 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:25.748763 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.quota [None req-5225aa98-6fd7-4431-ac9d-8776053de9d8 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Getting quotas for project e17967a941be4a04bbc180e2cf3a7a55. Resources: {'cores', 'instances', 'ram'} {{(pid=127198) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 16:35:25.753464 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.quota [None req-5225aa98-6fd7-4431-ac9d-8776053de9d8 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Getting quotas for user 53c0721dc18343b18993ff5af098841d and project e17967a941be4a04bbc180e2cf3a7a55. Resources: {'cores', 'instances', 'ram'} {{(pid=127198) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 16:35:25.773193 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-5225aa98-6fd7-4431-ac9d-8776053de9d8 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Going to run 1 instances... {{(pid=127198) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 16:35:25.776285 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-5225aa98-6fd7-4431-ac9d-8776053de9d8 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] [instance: 11fefdc7-238f-4580-96f8-d4ba861abeea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0b1ba34f-2223-497a-9a18-c2ad8d398aae',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127198) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 16:35:25.811497 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-d4099bba-8587-4e58-b952-ec13858cb2ab tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd095ed814b9e47e08d6b5a4fd2901c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f2e0c002343d88ae25dc7bfb2fe10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:25.827073 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-d4099bba-8587-4e58-b952-ec13858cb2ab tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] 10.222.0.23 "GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698" status: 200 len: 1676 microversion: 2.1 time: 0.312202 Sep 09 16:35:25.828956 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 237/473] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:35:25 2022] GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698 => generated 1676 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:35:25.863520 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-5225aa98-6fd7-4431-ac9d-8776053de9d8 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.739419 Sep 09 16:35:25.864857 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 237/474] 10.222.0.23 () {60 vars in 1147 bytes} [Fri Sep 9 16:35:25 2022] POST /compute/v2.1/servers => generated 402 bytes in 741 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 16:35:25.877958 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-7609c936-3900-40bb-846f-a8354836d940 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:35:25.879476 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-7609c936-3900-40bb-846f-a8354836d940 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] [instance: 11fefdc7-238f-4580-96f8-d4ba861abeea] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:35:25.950616 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-7609c936-3900-40bb-846f-a8354836d940 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c0721dc18343b18993ff5af098841d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17967a941be4a04bbc180e2cf3a7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:25.958950 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-7609c936-3900-40bb-846f-a8354836d940 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] 10.222.0.23 "GET /compute/v2.1/servers/11fefdc7-238f-4580-96f8-d4ba861abeea" status: 200 len: 1242 microversion: 2.1 time: 0.086816 Sep 09 16:35:25.959697 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 238/475] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:35:25 2022] GET /compute/v2.1/servers/11fefdc7-238f-4580-96f8-d4ba861abeea => generated 1242 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:35:26.015964 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-43ae1f01-66da-4abc-b867-bf32ebd5ce0a tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:35:26.017172 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-43ae1f01-66da-4abc-b867-bf32ebd5ce0a tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: 27b503a6-c023-49fb-b11a-37da810939cf] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:35:26.031041 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-43ae1f01-66da-4abc-b867-bf32ebd5ce0a tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:26.031832 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-43ae1f01-66da-4abc-b867-bf32ebd5ce0a tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:26.032466 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-43ae1f01-66da-4abc-b867-bf32ebd5ce0a tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:26.033380 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-43ae1f01-66da-4abc-b867-bf32ebd5ce0a tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:26.034014 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-43ae1f01-66da-4abc-b867-bf32ebd5ce0a tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:26.034929 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-43ae1f01-66da-4abc-b867-bf32ebd5ce0a tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:26.220587 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-43ae1f01-66da-4abc-b867-bf32ebd5ce0a tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:26.234076 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-43ae1f01-66da-4abc-b867-bf32ebd5ce0a tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:26.236208 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-43ae1f01-66da-4abc-b867-bf32ebd5ce0a tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:26.237667 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-43ae1f01-66da-4abc-b867-bf32ebd5ce0a tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf" status: 200 len: 1721 microversion: 2.20 time: 0.227965 Sep 09 16:35:26.239396 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 238/476] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Sep 9 16:35:26 2022] GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf => generated 1721 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 16:35:26.855675 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-d98fd791-6de3-4486-861f-8c67bddec7c0 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:35:26.856518 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-d98fd791-6de3-4486-861f-8c67bddec7c0 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] [instance: 9e761961-9c74-444c-bb4b-0b2f82a9d698] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:35:26.864137 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-d98fd791-6de3-4486-861f-8c67bddec7c0 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:26.864708 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-d98fd791-6de3-4486-861f-8c67bddec7c0 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:26.866417 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-d98fd791-6de3-4486-861f-8c67bddec7c0 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:26.867769 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-d98fd791-6de3-4486-861f-8c67bddec7c0 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:26.868291 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-d98fd791-6de3-4486-861f-8c67bddec7c0 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:26.868817 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-d98fd791-6de3-4486-861f-8c67bddec7c0 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:26.984932 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-cf188f2a-0bf4-48f5-8e60-4a3c44d9cddb tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:35:26.986585 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-cf188f2a-0bf4-48f5-8e60-4a3c44d9cddb tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] [instance: 11fefdc7-238f-4580-96f8-d4ba861abeea] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:35:26.994247 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cf188f2a-0bf4-48f5-8e60-4a3c44d9cddb tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:26.995063 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cf188f2a-0bf4-48f5-8e60-4a3c44d9cddb tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:26.995665 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cf188f2a-0bf4-48f5-8e60-4a3c44d9cddb tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:26.996536 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cf188f2a-0bf4-48f5-8e60-4a3c44d9cddb tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:26.997133 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cf188f2a-0bf4-48f5-8e60-4a3c44d9cddb tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:26.997709 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cf188f2a-0bf4-48f5-8e60-4a3c44d9cddb tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:27.025923 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-d98fd791-6de3-4486-861f-8c67bddec7c0 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd095ed814b9e47e08d6b5a4fd2901c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f2e0c002343d88ae25dc7bfb2fe10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:27.030911 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG dbcounter [-] [127196] Writing DB stats nova_cell1:SELECT=100 {{(pid=127196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:35:27.042660 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-d98fd791-6de3-4486-861f-8c67bddec7c0 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] 10.222.0.23 "GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698" status: 200 len: 1676 microversion: 2.1 time: 0.191536 Sep 09 16:35:27.043745 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 239/477] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:35:26 2022] GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698 => generated 1676 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:35:27.093834 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-cf188f2a-0bf4-48f5-8e60-4a3c44d9cddb tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c0721dc18343b18993ff5af098841d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17967a941be4a04bbc180e2cf3a7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:27.103520 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-cf188f2a-0bf4-48f5-8e60-4a3c44d9cddb tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] 10.222.0.23 "GET /compute/v2.1/servers/11fefdc7-238f-4580-96f8-d4ba861abeea" status: 200 len: 1246 microversion: 2.1 time: 0.123424 Sep 09 16:35:27.104378 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 239/478] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:35:26 2022] GET /compute/v2.1/servers/11fefdc7-238f-4580-96f8-d4ba861abeea => generated 1246 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:35:27.265253 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-7c8b7984-fda6-4b1a-889b-e27d4bb79f88 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:35:27.265966 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-7c8b7984-fda6-4b1a-889b-e27d4bb79f88 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: 27b503a6-c023-49fb-b11a-37da810939cf] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:35:27.272194 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-7c8b7984-fda6-4b1a-889b-e27d4bb79f88 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:27.275228 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-7c8b7984-fda6-4b1a-889b-e27d4bb79f88 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:27.279430 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-7c8b7984-fda6-4b1a-889b-e27d4bb79f88 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:27.280435 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-7c8b7984-fda6-4b1a-889b-e27d4bb79f88 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:27.284595 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-7c8b7984-fda6-4b1a-889b-e27d4bb79f88 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:27.285256 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-7c8b7984-fda6-4b1a-889b-e27d4bb79f88 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:27.439229 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-7c8b7984-fda6-4b1a-889b-e27d4bb79f88 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:27.449145 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-7c8b7984-fda6-4b1a-889b-e27d4bb79f88 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:27.450737 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-7c8b7984-fda6-4b1a-889b-e27d4bb79f88 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:27.451780 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-7c8b7984-fda6-4b1a-889b-e27d4bb79f88 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf" status: 200 len: 1721 microversion: 2.20 time: 0.190453 Sep 09 16:35:27.452874 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 240/479] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Sep 9 16:35:27 2022] GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf => generated 1721 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 16:35:28.067674 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-647c5e75-0cad-4aab-bfd1-f3acc1e072d0 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:35:28.068378 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-647c5e75-0cad-4aab-bfd1-f3acc1e072d0 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] [instance: 9e761961-9c74-444c-bb4b-0b2f82a9d698] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:35:28.077163 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-647c5e75-0cad-4aab-bfd1-f3acc1e072d0 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:28.077673 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-647c5e75-0cad-4aab-bfd1-f3acc1e072d0 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:28.078114 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-647c5e75-0cad-4aab-bfd1-f3acc1e072d0 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:28.078866 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-647c5e75-0cad-4aab-bfd1-f3acc1e072d0 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:28.079381 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-647c5e75-0cad-4aab-bfd1-f3acc1e072d0 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:28.079810 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-647c5e75-0cad-4aab-bfd1-f3acc1e072d0 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:28.139489 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-e59bcb52-592d-46bc-9959-075de8dd8567 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:35:28.143208 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-e59bcb52-592d-46bc-9959-075de8dd8567 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] [instance: 11fefdc7-238f-4580-96f8-d4ba861abeea] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:35:28.159387 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e59bcb52-592d-46bc-9959-075de8dd8567 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:28.159983 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e59bcb52-592d-46bc-9959-075de8dd8567 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:28.160604 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e59bcb52-592d-46bc-9959-075de8dd8567 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:28.161349 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e59bcb52-592d-46bc-9959-075de8dd8567 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:28.161805 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e59bcb52-592d-46bc-9959-075de8dd8567 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:28.162241 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e59bcb52-592d-46bc-9959-075de8dd8567 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:28.248317 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-e59bcb52-592d-46bc-9959-075de8dd8567 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c0721dc18343b18993ff5af098841d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17967a941be4a04bbc180e2cf3a7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:28.263654 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-e59bcb52-592d-46bc-9959-075de8dd8567 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] 10.222.0.23 "GET /compute/v2.1/servers/11fefdc7-238f-4580-96f8-d4ba861abeea" status: 200 len: 1238 microversion: 2.1 time: 0.134828 Sep 09 16:35:28.270566 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 241/480] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:35:28 2022] GET /compute/v2.1/servers/11fefdc7-238f-4580-96f8-d4ba861abeea => generated 1238 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:35:28.336249 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-647c5e75-0cad-4aab-bfd1-f3acc1e072d0 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd095ed814b9e47e08d6b5a4fd2901c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f2e0c002343d88ae25dc7bfb2fe10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:28.346426 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-647c5e75-0cad-4aab-bfd1-f3acc1e072d0 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] 10.222.0.23 "GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698" status: 200 len: 1676 microversion: 2.1 time: 0.282905 Sep 09 16:35:28.352707 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 240/481] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:35:28 2022] GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698 => generated 1676 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:35:28.477371 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-59454459-b75d-4def-aa20-242c3860ef61 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:35:28.478136 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-59454459-b75d-4def-aa20-242c3860ef61 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: 27b503a6-c023-49fb-b11a-37da810939cf] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:35:28.484722 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-59454459-b75d-4def-aa20-242c3860ef61 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:28.485355 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-59454459-b75d-4def-aa20-242c3860ef61 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:28.486001 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-59454459-b75d-4def-aa20-242c3860ef61 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:28.487068 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-59454459-b75d-4def-aa20-242c3860ef61 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:28.487633 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-59454459-b75d-4def-aa20-242c3860ef61 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:28.488246 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-59454459-b75d-4def-aa20-242c3860ef61 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:28.653873 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-59454459-b75d-4def-aa20-242c3860ef61 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:28.666616 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-59454459-b75d-4def-aa20-242c3860ef61 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:28.675629 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-59454459-b75d-4def-aa20-242c3860ef61 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:28.677136 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-59454459-b75d-4def-aa20-242c3860ef61 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf" status: 200 len: 1724 microversion: 2.20 time: 0.203939 Sep 09 16:35:28.678189 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 242/482] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Sep 9 16:35:28 2022] GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf => generated 1724 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 16:35:28.716489 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-9dfb9456-9869-4911-8c21-cf7f9737e82d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8cea5399-43a2-42ca-a9ee-ab1629cb437b"}} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:35:28.721777 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-9dfb9456-9869-4911-8c21-cf7f9737e82d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: 27b503a6-c023-49fb-b11a-37da810939cf] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:35:28.744193 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9dfb9456-9869-4911-8c21-cf7f9737e82d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:28.744660 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9dfb9456-9869-4911-8c21-cf7f9737e82d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:28.745262 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9dfb9456-9869-4911-8c21-cf7f9737e82d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:28.755006 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9dfb9456-9869-4911-8c21-cf7f9737e82d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:28.755489 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9dfb9456-9869-4911-8c21-cf7f9737e82d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:28.755918 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9dfb9456-9869-4911-8c21-cf7f9737e82d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:29.186364 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-9dfb9456-9869-4911-8c21-cf7f9737e82d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "POST /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.481607 Sep 09 16:35:29.187762 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 241/483] 10.222.0.23 () {62 vars in 1364 bytes} [Fri Sep 9 16:35:28 2022] POST /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf/os-volume_attachments => generated 188 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 16:35:29.288462 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-514e55e6-df1f-473e-acea-20e3f9f3f92b tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:35:29.288941 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-514e55e6-df1f-473e-acea-20e3f9f3f92b tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] [instance: 11fefdc7-238f-4580-96f8-d4ba861abeea] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:35:29.314979 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-514e55e6-df1f-473e-acea-20e3f9f3f92b tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:29.315794 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-514e55e6-df1f-473e-acea-20e3f9f3f92b tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:29.316392 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-514e55e6-df1f-473e-acea-20e3f9f3f92b tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:29.323662 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-514e55e6-df1f-473e-acea-20e3f9f3f92b tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:29.323927 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-514e55e6-df1f-473e-acea-20e3f9f3f92b tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:29.324459 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-514e55e6-df1f-473e-acea-20e3f9f3f92b tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:29.370470 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-4d0d185d-9dc4-4ed8-8031-3bef55fdc0ee tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:35:29.371650 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-4d0d185d-9dc4-4ed8-8031-3bef55fdc0ee tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] [instance: 9e761961-9c74-444c-bb4b-0b2f82a9d698] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:35:29.380374 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4d0d185d-9dc4-4ed8-8031-3bef55fdc0ee tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:29.380870 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4d0d185d-9dc4-4ed8-8031-3bef55fdc0ee tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:29.383622 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4d0d185d-9dc4-4ed8-8031-3bef55fdc0ee tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:29.384470 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4d0d185d-9dc4-4ed8-8031-3bef55fdc0ee tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:29.386001 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4d0d185d-9dc4-4ed8-8031-3bef55fdc0ee tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:29.388269 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4d0d185d-9dc4-4ed8-8031-3bef55fdc0ee tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:29.421905 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-514e55e6-df1f-473e-acea-20e3f9f3f92b tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c0721dc18343b18993ff5af098841d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17967a941be4a04bbc180e2cf3a7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:29.430646 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-514e55e6-df1f-473e-acea-20e3f9f3f92b tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] 10.222.0.23 "GET /compute/v2.1/servers/11fefdc7-238f-4580-96f8-d4ba861abeea" status: 200 len: 1294 microversion: 2.1 time: 0.147126 Sep 09 16:35:29.431231 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 243/484] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:35:29 2022] GET /compute/v2.1/servers/11fefdc7-238f-4580-96f8-d4ba861abeea => generated 1294 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:35:29.441329 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-668ee61f-9041-42e7-bd8b-8d805427cea7 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:35:29.453497 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-668ee61f-9041-42e7-bd8b-8d805427cea7 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: 27b503a6-c023-49fb-b11a-37da810939cf] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:35:29.460675 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-668ee61f-9041-42e7-bd8b-8d805427cea7 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:29.461450 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-668ee61f-9041-42e7-bd8b-8d805427cea7 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:29.462046 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-668ee61f-9041-42e7-bd8b-8d805427cea7 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:29.463597 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-668ee61f-9041-42e7-bd8b-8d805427cea7 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:29.464232 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-668ee61f-9041-42e7-bd8b-8d805427cea7 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:29.464803 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-668ee61f-9041-42e7-bd8b-8d805427cea7 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:29.531776 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-668ee61f-9041-42e7-bd8b-8d805427cea7 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: 27b503a6-c023-49fb-b11a-37da810939cf] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127196) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 09 16:35:29.610089 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-4d0d185d-9dc4-4ed8-8031-3bef55fdc0ee tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd095ed814b9e47e08d6b5a4fd2901c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f2e0c002343d88ae25dc7bfb2fe10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:29.631288 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-4d0d185d-9dc4-4ed8-8031-3bef55fdc0ee tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] 10.222.0.23 "GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698" status: 200 len: 1676 microversion: 2.1 time: 0.264451 Sep 09 16:35:29.649191 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 242/485] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:35:29 2022] GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698 => generated 1676 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 16:35:29.681016 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-668ee61f-9041-42e7-bd8b-8d805427cea7 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "POST /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf/action" status: 202 len: 0 microversion: 2.20 time: 0.246535 Sep 09 16:35:29.681955 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 244/486] 10.222.0.23 () {62 vars in 1319 bytes} [Fri Sep 9 16:35:29 2022] POST /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf/action => generated 0 bytes in 248 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 09 16:35:29.694892 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-9f0d3987-6399-4669-bda5-6be8efdb855c tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:35:29.695567 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-9f0d3987-6399-4669-bda5-6be8efdb855c tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: 27b503a6-c023-49fb-b11a-37da810939cf] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:35:29.710838 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9f0d3987-6399-4669-bda5-6be8efdb855c tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:29.712083 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9f0d3987-6399-4669-bda5-6be8efdb855c tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:29.714689 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9f0d3987-6399-4669-bda5-6be8efdb855c tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:29.715655 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9f0d3987-6399-4669-bda5-6be8efdb855c tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:29.716410 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9f0d3987-6399-4669-bda5-6be8efdb855c tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:29.717475 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9f0d3987-6399-4669-bda5-6be8efdb855c tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:29.937385 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-658f14b3-e4d3-46d2-8433-d5ce01496797 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:35:29.940117 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-658f14b3-e4d3-46d2-8433-d5ce01496797 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: 994c3400-0024-457d-88c7-e59b4053062c] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:35:29.946939 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-658f14b3-e4d3-46d2-8433-d5ce01496797 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:29.947880 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-658f14b3-e4d3-46d2-8433-d5ce01496797 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:29.948533 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-658f14b3-e4d3-46d2-8433-d5ce01496797 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:29.949548 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-658f14b3-e4d3-46d2-8433-d5ce01496797 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:29.950214 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-658f14b3-e4d3-46d2-8433-d5ce01496797 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:29.951058 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-658f14b3-e4d3-46d2-8433-d5ce01496797 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:30.003742 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.objects.instance [None req-658f14b3-e4d3-46d2-8433-d5ce01496797 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lazy-loading 'flavor' on Instance uuid 994c3400-0024-457d-88c7-e59b4053062c {{(pid=127196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 16:35:30.016571 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-9f0d3987-6399-4669-bda5-6be8efdb855c tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:30.029559 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-9f0d3987-6399-4669-bda5-6be8efdb855c tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:30.031214 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-9f0d3987-6399-4669-bda5-6be8efdb855c tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:30.033918 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-9f0d3987-6399-4669-bda5-6be8efdb855c tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf" status: 200 len: 1810 microversion: 2.20 time: 0.347143 Sep 09 16:35:30.034838 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 243/487] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Sep 9 16:35:29 2022] GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf => generated 1810 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 16:35:30.286038 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-658f14b3-e4d3-46d2-8433-d5ce01496797 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "POST /compute/v2.1/servers/994c3400-0024-457d-88c7-e59b4053062c/action" status: 200 len: 32 microversion: 2.1 time: 0.352866 Sep 09 16:35:30.288647 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 245/488] 10.222.0.23 () {60 vars in 1278 bytes} [Fri Sep 9 16:35:29 2022] POST /compute/v2.1/servers/994c3400-0024-457d-88c7-e59b4053062c/action => generated 32 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 09 16:35:30.300160 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-2691adc1-33cb-4cc9-86bf-ad2c5d680b0e tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:35:30.301661 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-2691adc1-33cb-4cc9-86bf-ad2c5d680b0e tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: 994c3400-0024-457d-88c7-e59b4053062c] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:35:30.311043 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2691adc1-33cb-4cc9-86bf-ad2c5d680b0e tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:30.312952 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2691adc1-33cb-4cc9-86bf-ad2c5d680b0e tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:30.314557 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2691adc1-33cb-4cc9-86bf-ad2c5d680b0e tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:30.315967 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2691adc1-33cb-4cc9-86bf-ad2c5d680b0e tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:30.317243 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2691adc1-33cb-4cc9-86bf-ad2c5d680b0e tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:30.317932 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2691adc1-33cb-4cc9-86bf-ad2c5d680b0e tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:30.372964 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=7,nova_cell1:INSERT=5 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:35:30.456671 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-f0bbd32c-9bfa-47ce-b315-b5638a56715c tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:35:30.457987 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-f0bbd32c-9bfa-47ce-b315-b5638a56715c tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] [instance: 11fefdc7-238f-4580-96f8-d4ba861abeea] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:35:30.479273 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f0bbd32c-9bfa-47ce-b315-b5638a56715c tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:30.484516 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f0bbd32c-9bfa-47ce-b315-b5638a56715c tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:30.485661 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f0bbd32c-9bfa-47ce-b315-b5638a56715c tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:30.487404 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f0bbd32c-9bfa-47ce-b315-b5638a56715c tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:30.488800 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f0bbd32c-9bfa-47ce-b315-b5638a56715c tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:30.490441 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f0bbd32c-9bfa-47ce-b315-b5638a56715c tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:30.728057 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-f0bbd32c-9bfa-47ce-b315-b5638a56715c tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c0721dc18343b18993ff5af098841d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17967a941be4a04bbc180e2cf3a7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:30.747146 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-f0bbd32c-9bfa-47ce-b315-b5638a56715c tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] 10.222.0.23 "GET /compute/v2.1/servers/11fefdc7-238f-4580-96f8-d4ba861abeea" status: 200 len: 1300 microversion: 2.1 time: 0.295684 Sep 09 16:35:30.748569 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 246/489] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:35:30 2022] GET /compute/v2.1/servers/11fefdc7-238f-4580-96f8-d4ba861abeea => generated 1300 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:35:30.758329 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-94147b73-3879-4ce2-bff1-3ea32ca53553 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:35:30.759226 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-94147b73-3879-4ce2-bff1-3ea32ca53553 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] [instance: 9e761961-9c74-444c-bb4b-0b2f82a9d698] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:35:30.765440 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-94147b73-3879-4ce2-bff1-3ea32ca53553 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:30.769820 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-94147b73-3879-4ce2-bff1-3ea32ca53553 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:30.770270 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-94147b73-3879-4ce2-bff1-3ea32ca53553 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:30.771496 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-94147b73-3879-4ce2-bff1-3ea32ca53553 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:30.771963 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-94147b73-3879-4ce2-bff1-3ea32ca53553 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:30.772387 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-94147b73-3879-4ce2-bff1-3ea32ca53553 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:30.896229 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-2691adc1-33cb-4cc9-86bf-ad2c5d680b0e tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d86f09c6304121be2021cb5c15e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ab544d0b547919794e3efb49ba0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:30.910525 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-2691adc1-33cb-4cc9-86bf-ad2c5d680b0e tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/994c3400-0024-457d-88c7-e59b4053062c" status: 200 len: 1734 microversion: 2.1 time: 0.613796 Sep 09 16:35:30.926955 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 244/490] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:35:30 2022] GET /compute/v2.1/servers/994c3400-0024-457d-88c7-e59b4053062c => generated 1734 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:35:30.929557 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [req-83676d27-bbf7-47f3-9182-5f4b6537e34d req-3a1ccecf-faba-41ca-8de7-a34e8f8df343 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27b503a6-c023-49fb-b11a-37da810939cf", "name": "network-vif-unplugged", "status": "completed", "tag": "56079a62-4748-409c-b913-eb3925499a09"}]} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:35:30.958664 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-83676d27-bbf7-47f3-9182-5f4b6537e34d req-3a1ccecf-faba-41ca-8de7-a34e8f8df343 service nova] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:30.962058 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-83676d27-bbf7-47f3-9182-5f4b6537e34d req-3a1ccecf-faba-41ca-8de7-a34e8f8df343 service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:30.962618 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-83676d27-bbf7-47f3-9182-5f4b6537e34d req-3a1ccecf-faba-41ca-8de7-a34e8f8df343 service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:30.998810 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.compute.server_external_events [req-83676d27-bbf7-47f3-9182-5f4b6537e34d req-3a1ccecf-faba-41ca-8de7-a34e8f8df343 service nova] Unable to find a host for instance 27b503a6-c023-49fb-b11a-37da810939cf. Dropping event network-vif-unplugged {{(pid=127198) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 09 16:35:30.999730 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [req-83676d27-bbf7-47f3-9182-5f4b6537e34d req-3a1ccecf-faba-41ca-8de7-a34e8f8df343 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.085972 Sep 09 16:35:31.000330 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 245/491] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Sep 9 16:35:30 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 87 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 09 16:35:31.060613 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-9ec96202-9219-4eed-ad13-0f970bfe115b tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:35:31.061532 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-9ec96202-9219-4eed-ad13-0f970bfe115b tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: 27b503a6-c023-49fb-b11a-37da810939cf] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:35:31.085820 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9ec96202-9219-4eed-ad13-0f970bfe115b tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:31.085994 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9ec96202-9219-4eed-ad13-0f970bfe115b tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:31.086653 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9ec96202-9219-4eed-ad13-0f970bfe115b tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:31.087538 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9ec96202-9219-4eed-ad13-0f970bfe115b tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:31.088147 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9ec96202-9219-4eed-ad13-0f970bfe115b tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:31.088712 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9ec96202-9219-4eed-ad13-0f970bfe115b tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:31.271352 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-94147b73-3879-4ce2-bff1-3ea32ca53553 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd095ed814b9e47e08d6b5a4fd2901c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f2e0c002343d88ae25dc7bfb2fe10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:31.281151 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-94147b73-3879-4ce2-bff1-3ea32ca53553 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] 10.222.0.23 "GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698" status: 200 len: 1676 microversion: 2.1 time: 0.531242 Sep 09 16:35:31.287129 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 247/492] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:35:30 2022] GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698 => generated 1676 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:35:31.296694 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-9ec96202-9219-4eed-ad13-0f970bfe115b tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:31.319981 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-9ec96202-9219-4eed-ad13-0f970bfe115b tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:31.321928 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-9ec96202-9219-4eed-ad13-0f970bfe115b tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:31.328584 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-9ec96202-9219-4eed-ad13-0f970bfe115b tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf" status: 200 len: 1750 microversion: 2.20 time: 0.269007 Sep 09 16:35:31.330338 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 246/493] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Sep 9 16:35:31 2022] GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf => generated 1750 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 16:35:31.771539 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-3f1b4460-cb36-4deb-8021-feae54ca6f9c tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:35:31.772390 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-3f1b4460-cb36-4deb-8021-feae54ca6f9c tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] [instance: 11fefdc7-238f-4580-96f8-d4ba861abeea] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:35:31.781688 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-3f1b4460-cb36-4deb-8021-feae54ca6f9c tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:31.795628 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-3f1b4460-cb36-4deb-8021-feae54ca6f9c tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:31.801345 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-3f1b4460-cb36-4deb-8021-feae54ca6f9c tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:31.803100 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-3f1b4460-cb36-4deb-8021-feae54ca6f9c tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:31.804847 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-3f1b4460-cb36-4deb-8021-feae54ca6f9c tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:31.806600 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-3f1b4460-cb36-4deb-8021-feae54ca6f9c tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:31.935621 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-c2dd6db7-7535-4953-83bd-a052f27bee88 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:35:31.936238 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-c2dd6db7-7535-4953-83bd-a052f27bee88 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: 994c3400-0024-457d-88c7-e59b4053062c] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:35:31.948939 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c2dd6db7-7535-4953-83bd-a052f27bee88 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:31.953116 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c2dd6db7-7535-4953-83bd-a052f27bee88 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:31.953797 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c2dd6db7-7535-4953-83bd-a052f27bee88 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:31.956550 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c2dd6db7-7535-4953-83bd-a052f27bee88 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:31.958548 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c2dd6db7-7535-4953-83bd-a052f27bee88 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:31.959207 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c2dd6db7-7535-4953-83bd-a052f27bee88 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:32.238855 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-c2dd6db7-7535-4953-83bd-a052f27bee88 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d86f09c6304121be2021cb5c15e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ab544d0b547919794e3efb49ba0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:32.251068 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-c2dd6db7-7535-4953-83bd-a052f27bee88 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/994c3400-0024-457d-88c7-e59b4053062c" status: 200 len: 1734 microversion: 2.1 time: 0.319996 Sep 09 16:35:32.264463 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 247/494] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:35:31 2022] GET /compute/v2.1/servers/994c3400-0024-457d-88c7-e59b4053062c => generated 1734 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 16:35:32.268150 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-3f1b4460-cb36-4deb-8021-feae54ca6f9c tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c0721dc18343b18993ff5af098841d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17967a941be4a04bbc180e2cf3a7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:32.277782 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-3f1b4460-cb36-4deb-8021-feae54ca6f9c tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] 10.222.0.23 "GET /compute/v2.1/servers/11fefdc7-238f-4580-96f8-d4ba861abeea" status: 200 len: 1368 microversion: 2.1 time: 0.509935 Sep 09 16:35:32.278452 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 248/495] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:35:31 2022] GET /compute/v2.1/servers/11fefdc7-238f-4580-96f8-d4ba861abeea => generated 1368 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 16:35:32.319159 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-cabda5a7-6077-4490-99bf-f5c9049510eb tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:35:32.320109 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-cabda5a7-6077-4490-99bf-f5c9049510eb tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] [instance: 9e761961-9c74-444c-bb4b-0b2f82a9d698] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:35:32.334147 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cabda5a7-6077-4490-99bf-f5c9049510eb tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:32.336451 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cabda5a7-6077-4490-99bf-f5c9049510eb tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:32.338523 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cabda5a7-6077-4490-99bf-f5c9049510eb tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:32.342106 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cabda5a7-6077-4490-99bf-f5c9049510eb tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:32.342849 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cabda5a7-6077-4490-99bf-f5c9049510eb tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:32.343438 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cabda5a7-6077-4490-99bf-f5c9049510eb tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:32.358517 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-c2026914-97d7-4934-8d42-53b641d0c62e tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:35:32.358964 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-c2026914-97d7-4934-8d42-53b641d0c62e tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: 27b503a6-c023-49fb-b11a-37da810939cf] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:35:32.387157 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-c2026914-97d7-4934-8d42-53b641d0c62e tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:32.387879 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-c2026914-97d7-4934-8d42-53b641d0c62e tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:32.393516 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-c2026914-97d7-4934-8d42-53b641d0c62e tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:32.396846 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-c2026914-97d7-4934-8d42-53b641d0c62e tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:32.397583 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-c2026914-97d7-4934-8d42-53b641d0c62e tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:32.398737 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-c2026914-97d7-4934-8d42-53b641d0c62e tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:32.634017 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-c2026914-97d7-4934-8d42-53b641d0c62e tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:32.644198 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-c2026914-97d7-4934-8d42-53b641d0c62e tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:32.650960 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-c2026914-97d7-4934-8d42-53b641d0c62e tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:32.656188 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-c2026914-97d7-4934-8d42-53b641d0c62e tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf" status: 200 len: 1752 microversion: 2.20 time: 0.303292 Sep 09 16:35:32.657069 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 249/496] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Sep 9 16:35:32 2022] GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf => generated 1752 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 16:35:32.697109 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-cabda5a7-6077-4490-99bf-f5c9049510eb tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd095ed814b9e47e08d6b5a4fd2901c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f2e0c002343d88ae25dc7bfb2fe10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:32.710394 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-cabda5a7-6077-4490-99bf-f5c9049510eb tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] 10.222.0.23 "GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698" status: 200 len: 1653 microversion: 2.1 time: 0.401639 Sep 09 16:35:32.713460 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 248/497] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:35:32 2022] GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698 => generated 1653 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:35:32.737941 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-3bb57cee-a7f3-4d3a-8147-487d00f49672 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:35:32.745331 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-3bb57cee-a7f3-4d3a-8147-487d00f49672 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:32.746097 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-3bb57cee-a7f3-4d3a-8147-487d00f49672 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:32.746828 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-3bb57cee-a7f3-4d3a-8147-487d00f49672 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:32.829735 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-3bb57cee-a7f3-4d3a-8147-487d00f49672 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] [instance: 9e761961-9c74-444c-bb4b-0b2f82a9d698] Going to try to start instance {{(pid=127196) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 09 16:35:32.903327 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-3bb57cee-a7f3-4d3a-8147-487d00f49672 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] 10.222.0.23 "POST /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698/action" status: 202 len: 0 microversion: 2.1 time: 0.170305 Sep 09 16:35:32.904170 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 250/498] 10.222.0.23 () {60 vars in 1278 bytes} [Fri Sep 9 16:35:32 2022] POST /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698/action => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 16:35:32.920343 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-65836aa4-43ce-4225-a6c9-ab2aceb96f49 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:35:32.920969 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-65836aa4-43ce-4225-a6c9-ab2aceb96f49 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] [instance: 9e761961-9c74-444c-bb4b-0b2f82a9d698] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:35:32.939460 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-65836aa4-43ce-4225-a6c9-ab2aceb96f49 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:32.951056 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-65836aa4-43ce-4225-a6c9-ab2aceb96f49 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:32.953328 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-65836aa4-43ce-4225-a6c9-ab2aceb96f49 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:32.955142 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-65836aa4-43ce-4225-a6c9-ab2aceb96f49 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:32.957453 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-65836aa4-43ce-4225-a6c9-ab2aceb96f49 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:32.957955 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-65836aa4-43ce-4225-a6c9-ab2aceb96f49 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:33.279688 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-24f195c2-b0e7-4b7a-a8be-2a93d07a86a6 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:35:33.280960 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-24f195c2-b0e7-4b7a-a8be-2a93d07a86a6 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: 994c3400-0024-457d-88c7-e59b4053062c] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:35:33.297734 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-24f195c2-b0e7-4b7a-a8be-2a93d07a86a6 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:33.299293 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-24f195c2-b0e7-4b7a-a8be-2a93d07a86a6 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:33.300066 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-24f195c2-b0e7-4b7a-a8be-2a93d07a86a6 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:33.303257 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-24f195c2-b0e7-4b7a-a8be-2a93d07a86a6 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:33.304577 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-24f195c2-b0e7-4b7a-a8be-2a93d07a86a6 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:33.305121 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-24f195c2-b0e7-4b7a-a8be-2a93d07a86a6 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:33.466591 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-65836aa4-43ce-4225-a6c9-ab2aceb96f49 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd095ed814b9e47e08d6b5a4fd2901c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f2e0c002343d88ae25dc7bfb2fe10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:33.487539 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-65836aa4-43ce-4225-a6c9-ab2aceb96f49 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] 10.222.0.23 "GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698" status: 200 len: 1662 microversion: 2.1 time: 0.578720 Sep 09 16:35:33.492221 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 249/499] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:35:32 2022] GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698 => generated 1662 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:35:33.497362 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-c63d9fb5-52c8-4deb-b2ef-29b27c6efd0f tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:35:33.498343 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-c63d9fb5-52c8-4deb-b2ef-29b27c6efd0f tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] [instance: 11fefdc7-238f-4580-96f8-d4ba861abeea] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:35:33.504992 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c63d9fb5-52c8-4deb-b2ef-29b27c6efd0f tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:33.505747 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c63d9fb5-52c8-4deb-b2ef-29b27c6efd0f tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:33.506314 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c63d9fb5-52c8-4deb-b2ef-29b27c6efd0f tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:33.507215 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c63d9fb5-52c8-4deb-b2ef-29b27c6efd0f tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:33.507830 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c63d9fb5-52c8-4deb-b2ef-29b27c6efd0f tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:33.508534 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c63d9fb5-52c8-4deb-b2ef-29b27c6efd0f tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:33.783768 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-24f195c2-b0e7-4b7a-a8be-2a93d07a86a6 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d86f09c6304121be2021cb5c15e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ab544d0b547919794e3efb49ba0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:33.792955 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-24f195c2-b0e7-4b7a-a8be-2a93d07a86a6 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/994c3400-0024-457d-88c7-e59b4053062c" status: 200 len: 1734 microversion: 2.1 time: 0.519344 Sep 09 16:35:33.793537 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 251/500] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:35:33 2022] GET /compute/v2.1/servers/994c3400-0024-457d-88c7-e59b4053062c => generated 1734 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 16:35:33.802289 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-5bc8c40f-28f1-4c4c-afa6-2cde361b0907 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:35:33.809554 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-5bc8c40f-28f1-4c4c-afa6-2cde361b0907 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: 27b503a6-c023-49fb-b11a-37da810939cf] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:35:33.822118 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-5bc8c40f-28f1-4c4c-afa6-2cde361b0907 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:33.824996 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-5bc8c40f-28f1-4c4c-afa6-2cde361b0907 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:33.825861 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-5bc8c40f-28f1-4c4c-afa6-2cde361b0907 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:33.826980 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-5bc8c40f-28f1-4c4c-afa6-2cde361b0907 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:33.829122 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-5bc8c40f-28f1-4c4c-afa6-2cde361b0907 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:33.829704 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-5bc8c40f-28f1-4c4c-afa6-2cde361b0907 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:33.868047 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-c63d9fb5-52c8-4deb-b2ef-29b27c6efd0f tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c0721dc18343b18993ff5af098841d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17967a941be4a04bbc180e2cf3a7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:33.870653 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG dbcounter [-] [127196] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=127196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:35:33.877176 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-c63d9fb5-52c8-4deb-b2ef-29b27c6efd0f tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] 10.222.0.23 "GET /compute/v2.1/servers/11fefdc7-238f-4580-96f8-d4ba861abeea" status: 200 len: 1368 microversion: 2.1 time: 0.383755 Sep 09 16:35:33.898932 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 250/501] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:35:33 2022] GET /compute/v2.1/servers/11fefdc7-238f-4580-96f8-d4ba861abeea => generated 1368 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:35:34.017132 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [req-044d224e-cbb0-495a-95f7-e8e72cff935e req-34410469-e3ca-4a99-8aa2-a71baf5540ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11fefdc7-238f-4580-96f8-d4ba861abeea", "tag": "c4a63018-5377-450a-9b13-cab181f1fd22"}]} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:35:34.037693 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-044d224e-cbb0-495a-95f7-e8e72cff935e req-34410469-e3ca-4a99-8aa2-a71baf5540ff service nova] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:34.043042 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-044d224e-cbb0-495a-95f7-e8e72cff935e req-34410469-e3ca-4a99-8aa2-a71baf5540ff service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:34.043621 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-044d224e-cbb0-495a-95f7-e8e72cff935e req-34410469-e3ca-4a99-8aa2-a71baf5540ff service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:34.069291 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.compute.server_external_events [req-044d224e-cbb0-495a-95f7-e8e72cff935e req-34410469-e3ca-4a99-8aa2-a71baf5540ff service nova] Creating event network-changed:c4a63018-5377-450a-9b13-cab181f1fd22 for instance 11fefdc7-238f-4580-96f8-d4ba861abeea on hv-cinder-83124 Sep 09 16:35:34.086469 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [req-044d224e-cbb0-495a-95f7-e8e72cff935e req-34410469-e3ca-4a99-8aa2-a71baf5540ff service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074418 Sep 09 16:35:34.091709 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 251/502] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Sep 9 16:35:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:35:34.522753 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-79bbb4cd-9d1e-4d8f-8358-55144e697091 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:35:34.524210 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-79bbb4cd-9d1e-4d8f-8358-55144e697091 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] [instance: 9e761961-9c74-444c-bb4b-0b2f82a9d698] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:35:34.530835 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-79bbb4cd-9d1e-4d8f-8358-55144e697091 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:34.531564 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-79bbb4cd-9d1e-4d8f-8358-55144e697091 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:34.532152 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-79bbb4cd-9d1e-4d8f-8358-55144e697091 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:34.533004 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-79bbb4cd-9d1e-4d8f-8358-55144e697091 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:34.533605 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-79bbb4cd-9d1e-4d8f-8358-55144e697091 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:34.534191 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-79bbb4cd-9d1e-4d8f-8358-55144e697091 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:34.694773 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-5bc8c40f-28f1-4c4c-afa6-2cde361b0907 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:34.705754 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-5bc8c40f-28f1-4c4c-afa6-2cde361b0907 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:34.707667 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-5bc8c40f-28f1-4c4c-afa6-2cde361b0907 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:34.709824 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-5bc8c40f-28f1-4c4c-afa6-2cde361b0907 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf" status: 200 len: 1808 microversion: 2.20 time: 0.911180 Sep 09 16:35:34.710786 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 252/503] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Sep 9 16:35:33 2022] GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf => generated 1808 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 16:35:34.822147 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-66780f41-d9f3-43fb-96cf-b23e19dc2f23 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:35:34.823229 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-66780f41-d9f3-43fb-96cf-b23e19dc2f23 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: 994c3400-0024-457d-88c7-e59b4053062c] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:35:34.830739 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-66780f41-d9f3-43fb-96cf-b23e19dc2f23 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:34.831494 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-66780f41-d9f3-43fb-96cf-b23e19dc2f23 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:34.832233 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-66780f41-d9f3-43fb-96cf-b23e19dc2f23 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:34.833149 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-66780f41-d9f3-43fb-96cf-b23e19dc2f23 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:34.833843 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-66780f41-d9f3-43fb-96cf-b23e19dc2f23 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:34.834312 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-66780f41-d9f3-43fb-96cf-b23e19dc2f23 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:34.908714 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-79bbb4cd-9d1e-4d8f-8358-55144e697091 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd095ed814b9e47e08d6b5a4fd2901c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f2e0c002343d88ae25dc7bfb2fe10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:34.917202 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-79bbb4cd-9d1e-4d8f-8358-55144e697091 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] 10.222.0.23 "GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698" status: 200 len: 1662 microversion: 2.1 time: 0.399211 Sep 09 16:35:34.924539 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 252/504] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:35:34 2022] GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698 => generated 1662 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:35:34.924539 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-1e3b4b38-bec4-4e30-94cb-8e979c9698cc tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:35:34.924539 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-1e3b4b38-bec4-4e30-94cb-8e979c9698cc tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] [instance: 11fefdc7-238f-4580-96f8-d4ba861abeea] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:35:34.932376 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1e3b4b38-bec4-4e30-94cb-8e979c9698cc tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:34.933188 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1e3b4b38-bec4-4e30-94cb-8e979c9698cc tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:34.934451 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1e3b4b38-bec4-4e30-94cb-8e979c9698cc tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:34.935389 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1e3b4b38-bec4-4e30-94cb-8e979c9698cc tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:34.935892 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1e3b4b38-bec4-4e30-94cb-8e979c9698cc tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:34.936392 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1e3b4b38-bec4-4e30-94cb-8e979c9698cc tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:35.095379 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-66780f41-d9f3-43fb-96cf-b23e19dc2f23 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d86f09c6304121be2021cb5c15e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ab544d0b547919794e3efb49ba0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:35.106080 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-66780f41-d9f3-43fb-96cf-b23e19dc2f23 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/994c3400-0024-457d-88c7-e59b4053062c" status: 200 len: 1734 microversion: 2.1 time: 0.287995 Sep 09 16:35:35.123929 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 253/505] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:35:34 2022] GET /compute/v2.1/servers/994c3400-0024-457d-88c7-e59b4053062c => generated 1734 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 16:35:35.181370 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-1e3b4b38-bec4-4e30-94cb-8e979c9698cc tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c0721dc18343b18993ff5af098841d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17967a941be4a04bbc180e2cf3a7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:35.190261 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-1e3b4b38-bec4-4e30-94cb-8e979c9698cc tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] 10.222.0.23 "GET /compute/v2.1/servers/11fefdc7-238f-4580-96f8-d4ba861abeea" status: 200 len: 1368 microversion: 2.1 time: 0.270385 Sep 09 16:35:35.191159 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 253/506] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:35:34 2022] GET /compute/v2.1/servers/11fefdc7-238f-4580-96f8-d4ba861abeea => generated 1368 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:35:35.735844 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-ceb80405-566b-4700-9dff-3ec32551a26b tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:35:35.740378 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-ceb80405-566b-4700-9dff-3ec32551a26b tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: 27b503a6-c023-49fb-b11a-37da810939cf] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:35:35.755999 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-ceb80405-566b-4700-9dff-3ec32551a26b tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:35.792480 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-ceb80405-566b-4700-9dff-3ec32551a26b tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.034s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:35.793098 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-ceb80405-566b-4700-9dff-3ec32551a26b tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:35.795084 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-ceb80405-566b-4700-9dff-3ec32551a26b tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:35.803175 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-ceb80405-566b-4700-9dff-3ec32551a26b tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:35.803635 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-ceb80405-566b-4700-9dff-3ec32551a26b tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:35.943299 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-42a2dd98-1708-4b5e-bd1f-18feb0d44a67 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:35:35.946918 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-42a2dd98-1708-4b5e-bd1f-18feb0d44a67 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] [instance: 9e761961-9c74-444c-bb4b-0b2f82a9d698] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:35:35.952900 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell0:SELECT=2 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:35:35.953893 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell0:SELECT=6 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:35:35.956097 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-42a2dd98-1708-4b5e-bd1f-18feb0d44a67 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:35.956677 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-42a2dd98-1708-4b5e-bd1f-18feb0d44a67 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:35.957345 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-42a2dd98-1708-4b5e-bd1f-18feb0d44a67 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:35.958318 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-42a2dd98-1708-4b5e-bd1f-18feb0d44a67 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:35.958913 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG dbcounter [-] [127196] Writing DB stats nova_cell0:SELECT=6 {{(pid=127196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:35:35.964419 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-42a2dd98-1708-4b5e-bd1f-18feb0d44a67 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:35.965679 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-42a2dd98-1708-4b5e-bd1f-18feb0d44a67 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:36.177365 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-ceb80405-566b-4700-9dff-3ec32551a26b tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:36.188544 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-ceb80405-566b-4700-9dff-3ec32551a26b tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:36.189471 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-ceb80405-566b-4700-9dff-3ec32551a26b tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:36.190679 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-ceb80405-566b-4700-9dff-3ec32551a26b tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf" status: 200 len: 1808 microversion: 2.20 time: 0.458797 Sep 09 16:35:36.191236 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 254/507] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Sep 9 16:35:35 2022] GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf => generated 1808 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 16:35:36.197559 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-75473f94-bdde-4ab0-8932-bb802d5b69b2 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:35:36.198327 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-75473f94-bdde-4ab0-8932-bb802d5b69b2 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: 994c3400-0024-457d-88c7-e59b4053062c] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:35:36.204470 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-75473f94-bdde-4ab0-8932-bb802d5b69b2 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:36.205121 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-75473f94-bdde-4ab0-8932-bb802d5b69b2 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:36.205713 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-75473f94-bdde-4ab0-8932-bb802d5b69b2 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:36.206583 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-75473f94-bdde-4ab0-8932-bb802d5b69b2 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:36.207225 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-75473f94-bdde-4ab0-8932-bb802d5b69b2 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:36.208173 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-75473f94-bdde-4ab0-8932-bb802d5b69b2 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:36.279978 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-42a2dd98-1708-4b5e-bd1f-18feb0d44a67 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd095ed814b9e47e08d6b5a4fd2901c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f2e0c002343d88ae25dc7bfb2fe10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:36.288729 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-42a2dd98-1708-4b5e-bd1f-18feb0d44a67 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] 10.222.0.23 "GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698" status: 200 len: 1662 microversion: 2.1 time: 0.350996 Sep 09 16:35:36.302793 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 254/508] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:35:35 2022] GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698 => generated 1662 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:35:36.302793 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-cd4a3ca7-d107-4c9e-a007-4d9eee1e02cf tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:35:36.302793 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-cd4a3ca7-d107-4c9e-a007-4d9eee1e02cf tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] [instance: 11fefdc7-238f-4580-96f8-d4ba861abeea] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:35:36.302793 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cd4a3ca7-d107-4c9e-a007-4d9eee1e02cf tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:36.303340 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cd4a3ca7-d107-4c9e-a007-4d9eee1e02cf tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:36.303340 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cd4a3ca7-d107-4c9e-a007-4d9eee1e02cf tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:36.303489 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cd4a3ca7-d107-4c9e-a007-4d9eee1e02cf tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:36.303835 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cd4a3ca7-d107-4c9e-a007-4d9eee1e02cf tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:36.304409 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cd4a3ca7-d107-4c9e-a007-4d9eee1e02cf tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:36.529291 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-75473f94-bdde-4ab0-8932-bb802d5b69b2 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d86f09c6304121be2021cb5c15e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ab544d0b547919794e3efb49ba0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:36.542257 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-75473f94-bdde-4ab0-8932-bb802d5b69b2 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/994c3400-0024-457d-88c7-e59b4053062c" status: 200 len: 1734 microversion: 2.1 time: 0.348113 Sep 09 16:35:36.552236 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 255/509] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:35:36 2022] GET /compute/v2.1/servers/994c3400-0024-457d-88c7-e59b4053062c => generated 1734 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:35:36.644602 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-cd4a3ca7-d107-4c9e-a007-4d9eee1e02cf tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c0721dc18343b18993ff5af098841d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17967a941be4a04bbc180e2cf3a7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:36.652638 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-cd4a3ca7-d107-4c9e-a007-4d9eee1e02cf tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] 10.222.0.23 "GET /compute/v2.1/servers/11fefdc7-238f-4580-96f8-d4ba861abeea" status: 200 len: 1368 microversion: 2.1 time: 0.361717 Sep 09 16:35:36.653182 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 255/510] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:35:36 2022] GET /compute/v2.1/servers/11fefdc7-238f-4580-96f8-d4ba861abeea => generated 1368 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:35:37.217401 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-fe23a822-319b-4d7a-bf52-da7feae28650 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:35:37.218806 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-fe23a822-319b-4d7a-bf52-da7feae28650 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: 27b503a6-c023-49fb-b11a-37da810939cf] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:35:37.226446 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-fe23a822-319b-4d7a-bf52-da7feae28650 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:37.227055 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-fe23a822-319b-4d7a-bf52-da7feae28650 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:37.227845 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-fe23a822-319b-4d7a-bf52-da7feae28650 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:37.228747 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-fe23a822-319b-4d7a-bf52-da7feae28650 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:37.229376 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-fe23a822-319b-4d7a-bf52-da7feae28650 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:37.229970 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-fe23a822-319b-4d7a-bf52-da7feae28650 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:37.316801 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-5fad22a6-8156-451c-a731-d48c1b7e7570 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:35:37.317429 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-5fad22a6-8156-451c-a731-d48c1b7e7570 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] [instance: 9e761961-9c74-444c-bb4b-0b2f82a9d698] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:35:37.340290 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5fad22a6-8156-451c-a731-d48c1b7e7570 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:37.342218 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5fad22a6-8156-451c-a731-d48c1b7e7570 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:37.346027 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5fad22a6-8156-451c-a731-d48c1b7e7570 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:37.347004 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5fad22a6-8156-451c-a731-d48c1b7e7570 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:37.347883 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5fad22a6-8156-451c-a731-d48c1b7e7570 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:37.348459 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5fad22a6-8156-451c-a731-d48c1b7e7570 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:37.434204 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-fe23a822-319b-4d7a-bf52-da7feae28650 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:37.448900 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-fe23a822-319b-4d7a-bf52-da7feae28650 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:37.450246 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-fe23a822-319b-4d7a-bf52-da7feae28650 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:37.467175 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-fe23a822-319b-4d7a-bf52-da7feae28650 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf" status: 200 len: 1808 microversion: 2.20 time: 0.253489 Sep 09 16:35:37.472068 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 256/511] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Sep 9 16:35:37 2022] GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf => generated 1808 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 16:35:37.565927 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-5fe933c6-58c9-46c4-a8c8-1f45d17abe98 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:35:37.566822 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-5fe933c6-58c9-46c4-a8c8-1f45d17abe98 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: 994c3400-0024-457d-88c7-e59b4053062c] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:35:37.573716 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-5fe933c6-58c9-46c4-a8c8-1f45d17abe98 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:37.579307 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-5fe933c6-58c9-46c4-a8c8-1f45d17abe98 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:37.582172 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-5fe933c6-58c9-46c4-a8c8-1f45d17abe98 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:37.585176 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-5fad22a6-8156-451c-a731-d48c1b7e7570 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd095ed814b9e47e08d6b5a4fd2901c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f2e0c002343d88ae25dc7bfb2fe10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:37.591055 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-5fe933c6-58c9-46c4-a8c8-1f45d17abe98 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:37.592353 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-5fe933c6-58c9-46c4-a8c8-1f45d17abe98 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:37.593974 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-5fe933c6-58c9-46c4-a8c8-1f45d17abe98 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:37.598385 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-5fad22a6-8156-451c-a731-d48c1b7e7570 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] 10.222.0.23 "GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698" status: 200 len: 1666 microversion: 2.1 time: 0.282280 Sep 09 16:35:37.599099 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 256/512] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:35:37 2022] GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698 => generated 1666 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:35:37.869433 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-171d2904-05ae-4ccb-9731-ca5640841c4c tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Action: 'create', calling method: .version_select at 0x7f24fb58e9d0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1912061220", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBHQ9Jjcv3qtI6MmVFhx8z6/7N6fjP3OcRvqzGvgfeM7NvIq/d+SpxzCGB1BkUMUtgF/95CjFpXKwFKLnRefdAQyVoo2twDWRipov6dyLzfvxS6TiPoReEVDQ/1Co0tP0A=="}} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:35:37.914842 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.quota [None req-171d2904-05ae-4ccb-9731-ca5640841c4c tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Getting quotas for project 1ba803ac5e71467f853215e19a7f8867. Resources: {'key_pairs'} {{(pid=127198) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 16:35:37.922113 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-5fe933c6-58c9-46c4-a8c8-1f45d17abe98 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d86f09c6304121be2021cb5c15e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ab544d0b547919794e3efb49ba0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:37.926606 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.quota [None req-171d2904-05ae-4ccb-9731-ca5640841c4c tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Getting quotas for user 208daa6413d34e4496e278fb3fc251a5 and project 1ba803ac5e71467f853215e19a7f8867. Resources: {'key_pairs'} {{(pid=127198) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 16:35:37.946524 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-5fe933c6-58c9-46c4-a8c8-1f45d17abe98 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/994c3400-0024-457d-88c7-e59b4053062c" status: 200 len: 1734 microversion: 2.1 time: 0.384470 Sep 09 16:35:37.952467 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 257/513] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:35:37 2022] GET /compute/v2.1/servers/994c3400-0024-457d-88c7-e59b4053062c => generated 1734 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 16:35:37.967302 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-e69775f6-835c-41a9-92ed-18c94251f226 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:35:37.967919 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-e69775f6-835c-41a9-92ed-18c94251f226 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] [instance: 11fefdc7-238f-4580-96f8-d4ba861abeea] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:35:37.977663 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-171d2904-05ae-4ccb-9731-ca5640841c4c tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.320429 Sep 09 16:35:37.978597 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 257/514] 10.222.0.23 () {60 vars in 1159 bytes} [Fri Sep 9 16:35:37 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 16:35:38.000425 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e69775f6-835c-41a9-92ed-18c94251f226 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:38.000935 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e69775f6-835c-41a9-92ed-18c94251f226 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:38.001372 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e69775f6-835c-41a9-92ed-18c94251f226 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:38.005122 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e69775f6-835c-41a9-92ed-18c94251f226 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:38.008131 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e69775f6-835c-41a9-92ed-18c94251f226 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:38.010458 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e69775f6-835c-41a9-92ed-18c94251f226 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:38.300681 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-e69775f6-835c-41a9-92ed-18c94251f226 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c0721dc18343b18993ff5af098841d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17967a941be4a04bbc180e2cf3a7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:38.309168 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-e69775f6-835c-41a9-92ed-18c94251f226 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] 10.222.0.23 "GET /compute/v2.1/servers/11fefdc7-238f-4580-96f8-d4ba861abeea" status: 200 len: 1368 microversion: 2.1 time: 0.354271 Sep 09 16:35:38.309760 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 258/515] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:35:37 2022] GET /compute/v2.1/servers/11fefdc7-238f-4580-96f8-d4ba861abeea => generated 1368 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:35:38.503957 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-531a9cae-3b19-43b7-84ab-c8d07a3900cb tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:35:38.504712 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-531a9cae-3b19-43b7-84ab-c8d07a3900cb tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: 27b503a6-c023-49fb-b11a-37da810939cf] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:35:38.521097 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-531a9cae-3b19-43b7-84ab-c8d07a3900cb tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:38.522632 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-531a9cae-3b19-43b7-84ab-c8d07a3900cb tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:38.524136 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-531a9cae-3b19-43b7-84ab-c8d07a3900cb tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:38.525295 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-531a9cae-3b19-43b7-84ab-c8d07a3900cb tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:38.528117 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-531a9cae-3b19-43b7-84ab-c8d07a3900cb tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:38.529326 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-531a9cae-3b19-43b7-84ab-c8d07a3900cb tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:38.833596 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-531a9cae-3b19-43b7-84ab-c8d07a3900cb tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:38.848687 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-531a9cae-3b19-43b7-84ab-c8d07a3900cb tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:38.850741 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-531a9cae-3b19-43b7-84ab-c8d07a3900cb tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:38.852141 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-531a9cae-3b19-43b7-84ab-c8d07a3900cb tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf" status: 200 len: 1808 microversion: 2.20 time: 0.355857 Sep 09 16:35:38.852869 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 258/516] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Sep 9 16:35:38 2022] GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf => generated 1808 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 16:35:38.980273 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-380f0714-c71f-4385-be0b-45aefe6fad03 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:35:38.981062 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-380f0714-c71f-4385-be0b-45aefe6fad03 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: 994c3400-0024-457d-88c7-e59b4053062c] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:35:38.991161 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-380f0714-c71f-4385-be0b-45aefe6fad03 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:38.991899 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-380f0714-c71f-4385-be0b-45aefe6fad03 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:38.992520 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-380f0714-c71f-4385-be0b-45aefe6fad03 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:38.995359 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-380f0714-c71f-4385-be0b-45aefe6fad03 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:38.996009 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-380f0714-c71f-4385-be0b-45aefe6fad03 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:38.997164 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-380f0714-c71f-4385-be0b-45aefe6fad03 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:39.332783 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-981af17d-053c-460a-a8c8-873f55cde75b tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:35:39.333393 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-981af17d-053c-460a-a8c8-873f55cde75b tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] [instance: 11fefdc7-238f-4580-96f8-d4ba861abeea] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:35:39.342832 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-981af17d-053c-460a-a8c8-873f55cde75b tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:39.342832 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-981af17d-053c-460a-a8c8-873f55cde75b tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:39.342832 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-981af17d-053c-460a-a8c8-873f55cde75b tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:39.342832 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-981af17d-053c-460a-a8c8-873f55cde75b tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:39.343246 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-981af17d-053c-460a-a8c8-873f55cde75b tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:39.343246 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-981af17d-053c-460a-a8c8-873f55cde75b tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:40.072001 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-981af17d-053c-460a-a8c8-873f55cde75b tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c0721dc18343b18993ff5af098841d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17967a941be4a04bbc180e2cf3a7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:40.088684 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-380f0714-c71f-4385-be0b-45aefe6fad03 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d86f09c6304121be2021cb5c15e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ab544d0b547919794e3efb49ba0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:40.089316 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-981af17d-053c-460a-a8c8-873f55cde75b tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] 10.222.0.23 "GET /compute/v2.1/servers/11fefdc7-238f-4580-96f8-d4ba861abeea" status: 200 len: 1368 microversion: 2.1 time: 0.760182 Sep 09 16:35:40.089854 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 259/517] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:35:39 2022] GET /compute/v2.1/servers/11fefdc7-238f-4580-96f8-d4ba861abeea => generated 1368 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 16:35:40.103267 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-380f0714-c71f-4385-be0b-45aefe6fad03 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/994c3400-0024-457d-88c7-e59b4053062c" status: 200 len: 1734 microversion: 2.1 time: 1.125739 Sep 09 16:35:40.103267 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 259/518] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:35:38 2022] GET /compute/v2.1/servers/994c3400-0024-457d-88c7-e59b4053062c => generated 1734 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:35:40.108041 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-d8773923-9e6b-42ce-acaf-8b24ee9ff545 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:35:40.108041 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-d8773923-9e6b-42ce-acaf-8b24ee9ff545 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: 27b503a6-c023-49fb-b11a-37da810939cf] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:35:40.123046 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d8773923-9e6b-42ce-acaf-8b24ee9ff545 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:40.123540 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d8773923-9e6b-42ce-acaf-8b24ee9ff545 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:40.124000 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d8773923-9e6b-42ce-acaf-8b24ee9ff545 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:40.130564 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d8773923-9e6b-42ce-acaf-8b24ee9ff545 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:40.131847 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d8773923-9e6b-42ce-acaf-8b24ee9ff545 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:40.132495 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d8773923-9e6b-42ce-acaf-8b24ee9ff545 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:40.353833 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-d8773923-9e6b-42ce-acaf-8b24ee9ff545 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:40.364269 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-d8773923-9e6b-42ce-acaf-8b24ee9ff545 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:40.365718 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-d8773923-9e6b-42ce-acaf-8b24ee9ff545 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:40.366998 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-d8773923-9e6b-42ce-acaf-8b24ee9ff545 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf" status: 200 len: 1808 microversion: 2.20 time: 0.276209 Sep 09 16:35:40.367551 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 260/519] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Sep 9 16:35:40 2022] GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf => generated 1808 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 16:35:40.787731 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [req-8ae91cb8-39fc-4976-b85e-2f24b45fe436 req-ddde0716-905b-42b2-a7c0-65ae7f66fe26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11fefdc7-238f-4580-96f8-d4ba861abeea", "name": "network-vif-plugged", "status": "completed", "tag": "c4a63018-5377-450a-9b13-cab181f1fd22"}]} {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:35:40.803361 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [req-8ae91cb8-39fc-4976-b85e-2f24b45fe436 req-ddde0716-905b-42b2-a7c0-65ae7f66fe26 service nova] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:40.803970 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [req-8ae91cb8-39fc-4976-b85e-2f24b45fe436 req-ddde0716-905b-42b2-a7c0-65ae7f66fe26 service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:40.804568 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [req-8ae91cb8-39fc-4976-b85e-2f24b45fe436 req-ddde0716-905b-42b2-a7c0-65ae7f66fe26 service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:40.823531 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.compute.server_external_events [req-8ae91cb8-39fc-4976-b85e-2f24b45fe436 req-ddde0716-905b-42b2-a7c0-65ae7f66fe26 service nova] Creating event network-vif-plugged:c4a63018-5377-450a-9b13-cab181f1fd22 for instance 11fefdc7-238f-4580-96f8-d4ba861abeea on hv-cinder-83124 Sep 09 16:35:40.831288 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [req-8ae91cb8-39fc-4976-b85e-2f24b45fe436 req-ddde0716-905b-42b2-a7c0-65ae7f66fe26 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048324 Sep 09 16:35:40.833364 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 260/520] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Sep 9 16:35:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:35:41.121765 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-f9b69d0e-b163-4512-bb07-a3ab078d09f2 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:35:41.123511 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-f9b69d0e-b163-4512-bb07-a3ab078d09f2 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] [instance: 11fefdc7-238f-4580-96f8-d4ba861abeea] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:35:41.135947 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-1ccce19a-8233-4682-8731-383940fa0b75 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:35:41.137482 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-1ccce19a-8233-4682-8731-383940fa0b75 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: 994c3400-0024-457d-88c7-e59b4053062c] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:35:41.156955 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f9b69d0e-b163-4512-bb07-a3ab078d09f2 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:41.157489 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-1ccce19a-8233-4682-8731-383940fa0b75 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:41.158948 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-1ccce19a-8233-4682-8731-383940fa0b75 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:41.159511 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f9b69d0e-b163-4512-bb07-a3ab078d09f2 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:41.160095 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-1ccce19a-8233-4682-8731-383940fa0b75 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:41.161146 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-1ccce19a-8233-4682-8731-383940fa0b75 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:41.161963 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f9b69d0e-b163-4512-bb07-a3ab078d09f2 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:41.162953 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f9b69d0e-b163-4512-bb07-a3ab078d09f2 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:41.163573 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-1ccce19a-8233-4682-8731-383940fa0b75 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:41.164613 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f9b69d0e-b163-4512-bb07-a3ab078d09f2 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:41.164999 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-1ccce19a-8233-4682-8731-383940fa0b75 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:41.169599 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f9b69d0e-b163-4512-bb07-a3ab078d09f2 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:41.552404 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-f9b69d0e-b163-4512-bb07-a3ab078d09f2 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c0721dc18343b18993ff5af098841d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17967a941be4a04bbc180e2cf3a7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:41.572205 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-1ccce19a-8233-4682-8731-383940fa0b75 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d86f09c6304121be2021cb5c15e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ab544d0b547919794e3efb49ba0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:41.572968 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-f9b69d0e-b163-4512-bb07-a3ab078d09f2 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] 10.222.0.23 "GET /compute/v2.1/servers/11fefdc7-238f-4580-96f8-d4ba861abeea" status: 200 len: 1368 microversion: 2.1 time: 0.457296 Sep 09 16:35:41.580823 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-1ccce19a-8233-4682-8731-383940fa0b75 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/994c3400-0024-457d-88c7-e59b4053062c" status: 200 len: 1734 microversion: 2.1 time: 0.452381 Sep 09 16:35:41.582870 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 261/521] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:35:41 2022] GET /compute/v2.1/servers/994c3400-0024-457d-88c7-e59b4053062c => generated 1734 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:35:41.591781 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-bc22b549-6b5f-432c-9194-9b46fd8cf8cd tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:35:41.592264 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 261/522] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:35:41 2022] GET /compute/v2.1/servers/11fefdc7-238f-4580-96f8-d4ba861abeea => generated 1368 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:35:41.593432 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-bc22b549-6b5f-432c-9194-9b46fd8cf8cd tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: 27b503a6-c023-49fb-b11a-37da810939cf] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:35:41.605373 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-bc22b549-6b5f-432c-9194-9b46fd8cf8cd tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:41.606024 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-bc22b549-6b5f-432c-9194-9b46fd8cf8cd tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:41.606666 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-bc22b549-6b5f-432c-9194-9b46fd8cf8cd tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:41.607559 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-bc22b549-6b5f-432c-9194-9b46fd8cf8cd tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:41.608179 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-bc22b549-6b5f-432c-9194-9b46fd8cf8cd tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:41.608774 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-bc22b549-6b5f-432c-9194-9b46fd8cf8cd tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:41.783157 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-bc22b549-6b5f-432c-9194-9b46fd8cf8cd tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:41.796677 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-bc22b549-6b5f-432c-9194-9b46fd8cf8cd tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:41.798699 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-bc22b549-6b5f-432c-9194-9b46fd8cf8cd tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:41.800978 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-bc22b549-6b5f-432c-9194-9b46fd8cf8cd tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf" status: 200 len: 1808 microversion: 2.20 time: 0.217016 Sep 09 16:35:41.801981 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 262/523] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Sep 9 16:35:41 2022] GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf => generated 1808 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 16:35:42.599996 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-8bcf5860-84d0-45a8-9e45-496b2a447ee5 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:35:42.600651 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-8bcf5860-84d0-45a8-9e45-496b2a447ee5 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] [instance: 11fefdc7-238f-4580-96f8-d4ba861abeea] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:35:42.604882 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-435a1cb0-2804-49a9-8a1c-311b19d1ef18 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:35:42.605489 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-435a1cb0-2804-49a9-8a1c-311b19d1ef18 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: 994c3400-0024-457d-88c7-e59b4053062c] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:35:42.607484 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8bcf5860-84d0-45a8-9e45-496b2a447ee5 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:42.607985 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8bcf5860-84d0-45a8-9e45-496b2a447ee5 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:42.608585 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8bcf5860-84d0-45a8-9e45-496b2a447ee5 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:42.610088 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8bcf5860-84d0-45a8-9e45-496b2a447ee5 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:42.610822 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8bcf5860-84d0-45a8-9e45-496b2a447ee5 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:42.611388 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8bcf5860-84d0-45a8-9e45-496b2a447ee5 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:42.612031 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-435a1cb0-2804-49a9-8a1c-311b19d1ef18 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:42.612700 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-435a1cb0-2804-49a9-8a1c-311b19d1ef18 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:42.613404 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-435a1cb0-2804-49a9-8a1c-311b19d1ef18 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:42.614275 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-435a1cb0-2804-49a9-8a1c-311b19d1ef18 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:42.614900 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-435a1cb0-2804-49a9-8a1c-311b19d1ef18 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:42.615477 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-435a1cb0-2804-49a9-8a1c-311b19d1ef18 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:42.833588 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-435a1cb0-2804-49a9-8a1c-311b19d1ef18 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d86f09c6304121be2021cb5c15e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ab544d0b547919794e3efb49ba0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:42.839784 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-8bcf5860-84d0-45a8-9e45-496b2a447ee5 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c0721dc18343b18993ff5af098841d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17967a941be4a04bbc180e2cf3a7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:42.844814 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-435a1cb0-2804-49a9-8a1c-311b19d1ef18 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/994c3400-0024-457d-88c7-e59b4053062c" status: 200 len: 1734 microversion: 2.1 time: 0.243629 Sep 09 16:35:42.845362 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 263/524] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:35:42 2022] GET /compute/v2.1/servers/994c3400-0024-457d-88c7-e59b4053062c => generated 1734 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:35:42.850347 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-8bcf5860-84d0-45a8-9e45-496b2a447ee5 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] 10.222.0.23 "GET /compute/v2.1/servers/11fefdc7-238f-4580-96f8-d4ba861abeea" status: 200 len: 1368 microversion: 2.1 time: 0.254180 Sep 09 16:35:42.850666 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-5b36586b-e9e6-4cad-b11d-d07678e3064b tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:35:42.851273 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-5b36586b-e9e6-4cad-b11d-d07678e3064b tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: 27b503a6-c023-49fb-b11a-37da810939cf] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:35:42.851709 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 262/525] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:35:42 2022] GET /compute/v2.1/servers/11fefdc7-238f-4580-96f8-d4ba861abeea => generated 1368 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:35:42.860705 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-5b36586b-e9e6-4cad-b11d-d07678e3064b tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:42.861277 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-5b36586b-e9e6-4cad-b11d-d07678e3064b tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:42.861709 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-5b36586b-e9e6-4cad-b11d-d07678e3064b tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:42.862462 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-5b36586b-e9e6-4cad-b11d-d07678e3064b tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:42.862941 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-5b36586b-e9e6-4cad-b11d-d07678e3064b tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:42.863572 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-5b36586b-e9e6-4cad-b11d-d07678e3064b tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:43.018479 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-5b36586b-e9e6-4cad-b11d-d07678e3064b tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:43.027974 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-5b36586b-e9e6-4cad-b11d-d07678e3064b tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:43.029429 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-5b36586b-e9e6-4cad-b11d-d07678e3064b tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:43.030631 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-5b36586b-e9e6-4cad-b11d-d07678e3064b tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf" status: 200 len: 1808 microversion: 2.20 time: 0.184148 Sep 09 16:35:43.031205 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 264/526] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Sep 9 16:35:42 2022] GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf => generated 1808 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 16:35:43.871022 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-718bf423-118e-4f01-8128-d69a96579bbe tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:35:43.871784 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-718bf423-118e-4f01-8128-d69a96579bbe tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: 994c3400-0024-457d-88c7-e59b4053062c] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:35:43.874280 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:35:43.875022 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-e62633db-70fd-43ea-a108-1b877ffff270 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:35:43.876331 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-e62633db-70fd-43ea-a108-1b877ffff270 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] [instance: 11fefdc7-238f-4580-96f8-d4ba861abeea] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:35:43.880732 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-718bf423-118e-4f01-8128-d69a96579bbe tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:43.881411 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-718bf423-118e-4f01-8128-d69a96579bbe tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:43.881843 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-718bf423-118e-4f01-8128-d69a96579bbe tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:43.882465 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e62633db-70fd-43ea-a108-1b877ffff270 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:43.882613 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-718bf423-118e-4f01-8128-d69a96579bbe tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:43.882979 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e62633db-70fd-43ea-a108-1b877ffff270 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:43.883081 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-718bf423-118e-4f01-8128-d69a96579bbe tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:43.883409 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e62633db-70fd-43ea-a108-1b877ffff270 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:43.883521 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-718bf423-118e-4f01-8128-d69a96579bbe tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:43.884094 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e62633db-70fd-43ea-a108-1b877ffff270 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:43.884577 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e62633db-70fd-43ea-a108-1b877ffff270 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:43.884965 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e62633db-70fd-43ea-a108-1b877ffff270 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:43.903295 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell1:SELECT=100 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:35:44.125937 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-718bf423-118e-4f01-8128-d69a96579bbe tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d86f09c6304121be2021cb5c15e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ab544d0b547919794e3efb49ba0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:44.137188 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-718bf423-118e-4f01-8128-d69a96579bbe tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/994c3400-0024-457d-88c7-e59b4053062c" status: 200 len: 1734 microversion: 2.1 time: 0.270852 Sep 09 16:35:44.139754 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 263/527] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:35:43 2022] GET /compute/v2.1/servers/994c3400-0024-457d-88c7-e59b4053062c => generated 1734 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:35:44.162878 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-ccf7a3bd-0fe7-47ec-b5c5-86ab859d3481 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:35:44.164062 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-ccf7a3bd-0fe7-47ec-b5c5-86ab859d3481 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: 27b503a6-c023-49fb-b11a-37da810939cf] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:35:44.171693 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ccf7a3bd-0fe7-47ec-b5c5-86ab859d3481 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:44.172617 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ccf7a3bd-0fe7-47ec-b5c5-86ab859d3481 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:44.173559 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ccf7a3bd-0fe7-47ec-b5c5-86ab859d3481 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:44.174518 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ccf7a3bd-0fe7-47ec-b5c5-86ab859d3481 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:44.175192 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ccf7a3bd-0fe7-47ec-b5c5-86ab859d3481 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:44.176000 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ccf7a3bd-0fe7-47ec-b5c5-86ab859d3481 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:44.176621 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-e62633db-70fd-43ea-a108-1b877ffff270 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c0721dc18343b18993ff5af098841d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17967a941be4a04bbc180e2cf3a7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:44.185437 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-e62633db-70fd-43ea-a108-1b877ffff270 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] 10.222.0.23 "GET /compute/v2.1/servers/11fefdc7-238f-4580-96f8-d4ba861abeea" status: 200 len: 1368 microversion: 2.1 time: 0.314494 Sep 09 16:35:44.186118 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 265/528] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:35:43 2022] GET /compute/v2.1/servers/11fefdc7-238f-4580-96f8-d4ba861abeea => generated 1368 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 16:35:44.324516 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-ccf7a3bd-0fe7-47ec-b5c5-86ab859d3481 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:44.333772 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-ccf7a3bd-0fe7-47ec-b5c5-86ab859d3481 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:44.335782 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-ccf7a3bd-0fe7-47ec-b5c5-86ab859d3481 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:44.337113 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-ccf7a3bd-0fe7-47ec-b5c5-86ab859d3481 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf" status: 200 len: 1808 microversion: 2.20 time: 0.180110 Sep 09 16:35:44.337671 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 264/529] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Sep 9 16:35:44 2022] GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf => generated 1808 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 16:35:45.164254 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-73ed1bc4-70c1-43b3-aaa0-e08c06016aa5 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:35:45.164934 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-73ed1bc4-70c1-43b3-aaa0-e08c06016aa5 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: 994c3400-0024-457d-88c7-e59b4053062c] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:35:45.172231 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG dbcounter [-] [127196] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=127196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:35:45.173708 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-73ed1bc4-70c1-43b3-aaa0-e08c06016aa5 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:45.174195 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-73ed1bc4-70c1-43b3-aaa0-e08c06016aa5 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:45.174665 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-73ed1bc4-70c1-43b3-aaa0-e08c06016aa5 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:45.175380 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-73ed1bc4-70c1-43b3-aaa0-e08c06016aa5 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:45.175865 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-73ed1bc4-70c1-43b3-aaa0-e08c06016aa5 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:45.176283 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-73ed1bc4-70c1-43b3-aaa0-e08c06016aa5 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:45.209063 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-e6f6e600-92d0-4a23-9d70-b202c66803fb tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:35:45.210337 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-e6f6e600-92d0-4a23-9d70-b202c66803fb tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] [instance: 11fefdc7-238f-4580-96f8-d4ba861abeea] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:35:45.225590 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e6f6e600-92d0-4a23-9d70-b202c66803fb tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:45.226070 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e6f6e600-92d0-4a23-9d70-b202c66803fb tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:45.226559 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e6f6e600-92d0-4a23-9d70-b202c66803fb tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:45.227474 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e6f6e600-92d0-4a23-9d70-b202c66803fb tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:45.227961 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e6f6e600-92d0-4a23-9d70-b202c66803fb tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:45.228558 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e6f6e600-92d0-4a23-9d70-b202c66803fb tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:45.381345 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-73ed1bc4-70c1-43b3-aaa0-e08c06016aa5 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d86f09c6304121be2021cb5c15e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ab544d0b547919794e3efb49ba0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:45.391423 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-73ed1bc4-70c1-43b3-aaa0-e08c06016aa5 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/994c3400-0024-457d-88c7-e59b4053062c" status: 200 len: 1734 microversion: 2.1 time: 0.231985 Sep 09 16:35:45.392246 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 266/530] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:35:45 2022] GET /compute/v2.1/servers/994c3400-0024-457d-88c7-e59b4053062c => generated 1734 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:35:45.398206 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-ffd12648-7bac-4e72-93b2-d0a7cb23b1d5 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:35:45.402538 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-ffd12648-7bac-4e72-93b2-d0a7cb23b1d5 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: 27b503a6-c023-49fb-b11a-37da810939cf] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:35:45.406769 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-ffd12648-7bac-4e72-93b2-d0a7cb23b1d5 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:45.407266 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-ffd12648-7bac-4e72-93b2-d0a7cb23b1d5 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:45.407686 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-ffd12648-7bac-4e72-93b2-d0a7cb23b1d5 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:45.408385 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-ffd12648-7bac-4e72-93b2-d0a7cb23b1d5 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:45.408834 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-ffd12648-7bac-4e72-93b2-d0a7cb23b1d5 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:45.409251 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-ffd12648-7bac-4e72-93b2-d0a7cb23b1d5 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:45.428633 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-e6f6e600-92d0-4a23-9d70-b202c66803fb tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c0721dc18343b18993ff5af098841d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17967a941be4a04bbc180e2cf3a7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:45.436831 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-e6f6e600-92d0-4a23-9d70-b202c66803fb tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] 10.222.0.23 "GET /compute/v2.1/servers/11fefdc7-238f-4580-96f8-d4ba861abeea" status: 200 len: 1368 microversion: 2.1 time: 0.232014 Sep 09 16:35:45.450887 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 265/531] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:35:45 2022] GET /compute/v2.1/servers/11fefdc7-238f-4580-96f8-d4ba861abeea => generated 1368 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 16:35:45.577176 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-ffd12648-7bac-4e72-93b2-d0a7cb23b1d5 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:45.586245 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-ffd12648-7bac-4e72-93b2-d0a7cb23b1d5 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:45.587728 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-ffd12648-7bac-4e72-93b2-d0a7cb23b1d5 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:45.588910 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-ffd12648-7bac-4e72-93b2-d0a7cb23b1d5 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf" status: 200 len: 1808 microversion: 2.20 time: 0.195705 Sep 09 16:35:45.589698 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 267/532] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Sep 9 16:35:45 2022] GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf => generated 1808 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 16:35:46.415864 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-41654587-d143-4f3e-8aa0-e6c59d9a66b7 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:35:46.416455 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-41654587-d143-4f3e-8aa0-e6c59d9a66b7 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: 994c3400-0024-457d-88c7-e59b4053062c] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:35:46.423669 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-41654587-d143-4f3e-8aa0-e6c59d9a66b7 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:46.424154 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-41654587-d143-4f3e-8aa0-e6c59d9a66b7 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:46.424584 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-41654587-d143-4f3e-8aa0-e6c59d9a66b7 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:46.425275 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-41654587-d143-4f3e-8aa0-e6c59d9a66b7 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:46.425865 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-41654587-d143-4f3e-8aa0-e6c59d9a66b7 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:46.426289 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-41654587-d143-4f3e-8aa0-e6c59d9a66b7 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:46.460663 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-92079dac-400f-47dc-8d1b-b52d2bf92907 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:35:46.461275 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-92079dac-400f-47dc-8d1b-b52d2bf92907 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] [instance: 11fefdc7-238f-4580-96f8-d4ba861abeea] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:35:46.468458 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-92079dac-400f-47dc-8d1b-b52d2bf92907 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:46.468663 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-92079dac-400f-47dc-8d1b-b52d2bf92907 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:46.469117 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-92079dac-400f-47dc-8d1b-b52d2bf92907 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:46.469814 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-92079dac-400f-47dc-8d1b-b52d2bf92907 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:46.470266 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-92079dac-400f-47dc-8d1b-b52d2bf92907 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:46.470716 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-92079dac-400f-47dc-8d1b-b52d2bf92907 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:46.624469 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-41654587-d143-4f3e-8aa0-e6c59d9a66b7 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d86f09c6304121be2021cb5c15e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ab544d0b547919794e3efb49ba0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:46.633745 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-41654587-d143-4f3e-8aa0-e6c59d9a66b7 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/994c3400-0024-457d-88c7-e59b4053062c" status: 200 len: 1734 microversion: 2.1 time: 0.221848 Sep 09 16:35:46.634321 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 266/533] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:35:46 2022] GET /compute/v2.1/servers/994c3400-0024-457d-88c7-e59b4053062c => generated 1734 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:35:46.638834 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-8533e978-dd7f-459f-bee0-df7b2c88b397 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:35:46.639402 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-8533e978-dd7f-459f-bee0-df7b2c88b397 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: 27b503a6-c023-49fb-b11a-37da810939cf] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:35:46.646172 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8533e978-dd7f-459f-bee0-df7b2c88b397 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:46.646691 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8533e978-dd7f-459f-bee0-df7b2c88b397 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:46.647122 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8533e978-dd7f-459f-bee0-df7b2c88b397 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:46.647810 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8533e978-dd7f-459f-bee0-df7b2c88b397 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:46.648224 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8533e978-dd7f-459f-bee0-df7b2c88b397 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:46.648950 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8533e978-dd7f-459f-bee0-df7b2c88b397 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:46.651831 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-92079dac-400f-47dc-8d1b-b52d2bf92907 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c0721dc18343b18993ff5af098841d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17967a941be4a04bbc180e2cf3a7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:46.660087 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-92079dac-400f-47dc-8d1b-b52d2bf92907 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] 10.222.0.23 "GET /compute/v2.1/servers/11fefdc7-238f-4580-96f8-d4ba861abeea" status: 200 len: 1368 microversion: 2.1 time: 0.203348 Sep 09 16:35:46.660961 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 268/534] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:35:46 2022] GET /compute/v2.1/servers/11fefdc7-238f-4580-96f8-d4ba861abeea => generated 1368 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:35:46.782407 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-8533e978-dd7f-459f-bee0-df7b2c88b397 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:46.791189 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-8533e978-dd7f-459f-bee0-df7b2c88b397 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:46.792620 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-8533e978-dd7f-459f-bee0-df7b2c88b397 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:46.794135 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-8533e978-dd7f-459f-bee0-df7b2c88b397 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf" status: 200 len: 1808 microversion: 2.20 time: 0.158498 Sep 09 16:35:46.794726 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 267/535] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Sep 9 16:35:46 2022] GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 16:35:47.659633 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-5c84a12a-d650-4143-a764-9572e3f7e048 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:35:47.660485 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-5c84a12a-d650-4143-a764-9572e3f7e048 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: 994c3400-0024-457d-88c7-e59b4053062c] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:35:47.667479 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-5c84a12a-d650-4143-a764-9572e3f7e048 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:47.667890 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-5c84a12a-d650-4143-a764-9572e3f7e048 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:47.668701 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-5c84a12a-d650-4143-a764-9572e3f7e048 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:47.669392 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-5c84a12a-d650-4143-a764-9572e3f7e048 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:47.669850 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-5c84a12a-d650-4143-a764-9572e3f7e048 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:47.670297 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-5c84a12a-d650-4143-a764-9572e3f7e048 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:47.683513 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-8c9a8d5f-5fc8-42ce-8048-d37d7b8d372b tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:35:47.684147 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-8c9a8d5f-5fc8-42ce-8048-d37d7b8d372b tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] [instance: 11fefdc7-238f-4580-96f8-d4ba861abeea] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:35:47.691932 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8c9a8d5f-5fc8-42ce-8048-d37d7b8d372b tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:47.692051 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8c9a8d5f-5fc8-42ce-8048-d37d7b8d372b tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:47.692410 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8c9a8d5f-5fc8-42ce-8048-d37d7b8d372b tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:47.693132 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8c9a8d5f-5fc8-42ce-8048-d37d7b8d372b tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:47.693563 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8c9a8d5f-5fc8-42ce-8048-d37d7b8d372b tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:47.693984 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8c9a8d5f-5fc8-42ce-8048-d37d7b8d372b tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:47.874557 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-5c84a12a-d650-4143-a764-9572e3f7e048 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d86f09c6304121be2021cb5c15e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ab544d0b547919794e3efb49ba0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:47.877808 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-8c9a8d5f-5fc8-42ce-8048-d37d7b8d372b tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c0721dc18343b18993ff5af098841d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17967a941be4a04bbc180e2cf3a7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:47.878320 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG dbcounter [-] [127196] Writing DB stats nova_cell1:SELECT=100 {{(pid=127196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:35:47.884077 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-5c84a12a-d650-4143-a764-9572e3f7e048 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/994c3400-0024-457d-88c7-e59b4053062c" status: 200 len: 1734 microversion: 2.1 time: 0.229726 Sep 09 16:35:47.884766 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 269/536] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:35:47 2022] GET /compute/v2.1/servers/994c3400-0024-457d-88c7-e59b4053062c => generated 1734 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:35:47.886044 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-8c9a8d5f-5fc8-42ce-8048-d37d7b8d372b tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] 10.222.0.23 "GET /compute/v2.1/servers/11fefdc7-238f-4580-96f8-d4ba861abeea" status: 200 len: 1368 microversion: 2.1 time: 0.206334 Sep 09 16:35:47.895036 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 268/537] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:35:47 2022] GET /compute/v2.1/servers/11fefdc7-238f-4580-96f8-d4ba861abeea => generated 1368 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:35:47.895208 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-71c4c353-f118-4798-91c2-9f79eb39f283 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:35:47.895208 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-71c4c353-f118-4798-91c2-9f79eb39f283 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: 27b503a6-c023-49fb-b11a-37da810939cf] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:35:47.896027 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-71c4c353-f118-4798-91c2-9f79eb39f283 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:47.896590 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-71c4c353-f118-4798-91c2-9f79eb39f283 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:47.897107 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-71c4c353-f118-4798-91c2-9f79eb39f283 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:47.897866 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-71c4c353-f118-4798-91c2-9f79eb39f283 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:47.898394 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-71c4c353-f118-4798-91c2-9f79eb39f283 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:47.898907 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-71c4c353-f118-4798-91c2-9f79eb39f283 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:48.044636 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-71c4c353-f118-4798-91c2-9f79eb39f283 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:48.053984 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-71c4c353-f118-4798-91c2-9f79eb39f283 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:48.055457 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-71c4c353-f118-4798-91c2-9f79eb39f283 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:48.056929 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-71c4c353-f118-4798-91c2-9f79eb39f283 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf" status: 200 len: 1808 microversion: 2.20 time: 0.171016 Sep 09 16:35:48.057614 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 270/538] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Sep 9 16:35:47 2022] GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf => generated 1808 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 16:35:48.908990 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-af86965e-28f0-4f42-ba71-85554994fde7 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:35:48.909650 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-af86965e-28f0-4f42-ba71-85554994fde7 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: 994c3400-0024-457d-88c7-e59b4053062c] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:35:48.909935 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-755641f9-7630-4469-a53f-793e7e511b63 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:35:48.910705 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-755641f9-7630-4469-a53f-793e7e511b63 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] [instance: 11fefdc7-238f-4580-96f8-d4ba861abeea] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:35:48.911851 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell0:SELECT=4 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:35:48.917619 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-755641f9-7630-4469-a53f-793e7e511b63 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:48.918098 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-755641f9-7630-4469-a53f-793e7e511b63 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:48.918217 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-af86965e-28f0-4f42-ba71-85554994fde7 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:48.918917 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-755641f9-7630-4469-a53f-793e7e511b63 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:48.919044 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-af86965e-28f0-4f42-ba71-85554994fde7 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:48.919390 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-af86965e-28f0-4f42-ba71-85554994fde7 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:48.919607 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-755641f9-7630-4469-a53f-793e7e511b63 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:48.920061 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-755641f9-7630-4469-a53f-793e7e511b63 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:48.920164 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-af86965e-28f0-4f42-ba71-85554994fde7 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:48.920483 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-755641f9-7630-4469-a53f-793e7e511b63 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:48.920579 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-af86965e-28f0-4f42-ba71-85554994fde7 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:48.920937 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-af86965e-28f0-4f42-ba71-85554994fde7 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:49.119757 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-af86965e-28f0-4f42-ba71-85554994fde7 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d86f09c6304121be2021cb5c15e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ab544d0b547919794e3efb49ba0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:49.122939 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-755641f9-7630-4469-a53f-793e7e511b63 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c0721dc18343b18993ff5af098841d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17967a941be4a04bbc180e2cf3a7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:49.128407 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-af86965e-28f0-4f42-ba71-85554994fde7 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/994c3400-0024-457d-88c7-e59b4053062c" status: 200 len: 1734 microversion: 2.1 time: 0.224039 Sep 09 16:35:49.129261 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 269/539] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:35:48 2022] GET /compute/v2.1/servers/994c3400-0024-457d-88c7-e59b4053062c => generated 1734 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:35:49.131350 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-755641f9-7630-4469-a53f-793e7e511b63 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] 10.222.0.23 "GET /compute/v2.1/servers/11fefdc7-238f-4580-96f8-d4ba861abeea" status: 200 len: 1368 microversion: 2.1 time: 0.226021 Sep 09 16:35:49.132221 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 271/540] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:35:48 2022] GET /compute/v2.1/servers/11fefdc7-238f-4580-96f8-d4ba861abeea => generated 1368 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:35:49.133722 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-542be872-80a0-4c27-a3df-94e653438426 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:35:49.134409 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-542be872-80a0-4c27-a3df-94e653438426 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: 27b503a6-c023-49fb-b11a-37da810939cf] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:35:49.140446 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-542be872-80a0-4c27-a3df-94e653438426 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:49.140999 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-542be872-80a0-4c27-a3df-94e653438426 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:49.142852 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-542be872-80a0-4c27-a3df-94e653438426 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:49.142852 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-542be872-80a0-4c27-a3df-94e653438426 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:49.142852 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-542be872-80a0-4c27-a3df-94e653438426 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:49.143153 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-542be872-80a0-4c27-a3df-94e653438426 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:49.277682 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-542be872-80a0-4c27-a3df-94e653438426 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:49.288554 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-542be872-80a0-4c27-a3df-94e653438426 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:49.288554 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-542be872-80a0-4c27-a3df-94e653438426 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:49.289341 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-542be872-80a0-4c27-a3df-94e653438426 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf" status: 200 len: 1808 microversion: 2.20 time: 0.159357 Sep 09 16:35:49.289888 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 270/541] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Sep 9 16:35:49 2022] GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 16:35:50.152406 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-e4131350-fd6e-4a49-b67c-a7f6beb28e7e tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:35:50.153216 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-6c1d2a6c-36e8-4174-9823-9a232697efa6 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:35:50.153654 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-e4131350-fd6e-4a49-b67c-a7f6beb28e7e tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: 994c3400-0024-457d-88c7-e59b4053062c] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:35:50.154467 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-6c1d2a6c-36e8-4174-9823-9a232697efa6 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] [instance: 11fefdc7-238f-4580-96f8-d4ba861abeea] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:35:50.161679 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6c1d2a6c-36e8-4174-9823-9a232697efa6 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:50.162162 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6c1d2a6c-36e8-4174-9823-9a232697efa6 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:50.162413 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e4131350-fd6e-4a49-b67c-a7f6beb28e7e tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:50.162629 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6c1d2a6c-36e8-4174-9823-9a232697efa6 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:50.162984 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e4131350-fd6e-4a49-b67c-a7f6beb28e7e tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:50.163480 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6c1d2a6c-36e8-4174-9823-9a232697efa6 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:50.163613 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e4131350-fd6e-4a49-b67c-a7f6beb28e7e tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:50.163939 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6c1d2a6c-36e8-4174-9823-9a232697efa6 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:50.164352 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6c1d2a6c-36e8-4174-9823-9a232697efa6 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:50.164553 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e4131350-fd6e-4a49-b67c-a7f6beb28e7e tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:50.166349 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e4131350-fd6e-4a49-b67c-a7f6beb28e7e tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:50.166950 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e4131350-fd6e-4a49-b67c-a7f6beb28e7e tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:50.376593 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-e4131350-fd6e-4a49-b67c-a7f6beb28e7e tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d86f09c6304121be2021cb5c15e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ab544d0b547919794e3efb49ba0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:50.379804 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-6c1d2a6c-36e8-4174-9823-9a232697efa6 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c0721dc18343b18993ff5af098841d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17967a941be4a04bbc180e2cf3a7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:50.386278 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-e4131350-fd6e-4a49-b67c-a7f6beb28e7e tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/994c3400-0024-457d-88c7-e59b4053062c" status: 200 len: 1734 microversion: 2.1 time: 0.238007 Sep 09 16:35:50.387006 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 272/542] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:35:50 2022] GET /compute/v2.1/servers/994c3400-0024-457d-88c7-e59b4053062c => generated 1734 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:35:50.388148 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-6c1d2a6c-36e8-4174-9823-9a232697efa6 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] 10.222.0.23 "GET /compute/v2.1/servers/11fefdc7-238f-4580-96f8-d4ba861abeea" status: 200 len: 1558 microversion: 2.1 time: 0.238682 Sep 09 16:35:50.388740 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 271/543] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:35:50 2022] GET /compute/v2.1/servers/11fefdc7-238f-4580-96f8-d4ba861abeea => generated 1558 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 16:35:50.391706 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-12e61755-af5e-4943-8bbd-4cd80e739bc4 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:35:50.392361 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-12e61755-af5e-4943-8bbd-4cd80e739bc4 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: 27b503a6-c023-49fb-b11a-37da810939cf] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:35:50.398209 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-12e61755-af5e-4943-8bbd-4cd80e739bc4 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:50.398789 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-12e61755-af5e-4943-8bbd-4cd80e739bc4 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:50.399300 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-12e61755-af5e-4943-8bbd-4cd80e739bc4 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:50.400073 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-12e61755-af5e-4943-8bbd-4cd80e739bc4 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:50.400670 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-12e61755-af5e-4943-8bbd-4cd80e739bc4 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:50.401146 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-12e61755-af5e-4943-8bbd-4cd80e739bc4 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:50.410056 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-496d0bd7-170e-445f-a587-651af3f86087 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:35:50.410821 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-496d0bd7-170e-445f-a587-651af3f86087 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] [instance: 11fefdc7-238f-4580-96f8-d4ba861abeea] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:35:50.416886 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-496d0bd7-170e-445f-a587-651af3f86087 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:50.417362 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-496d0bd7-170e-445f-a587-651af3f86087 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:50.417786 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-496d0bd7-170e-445f-a587-651af3f86087 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:50.418875 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-496d0bd7-170e-445f-a587-651af3f86087 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:50.419319 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-496d0bd7-170e-445f-a587-651af3f86087 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:50.419736 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-496d0bd7-170e-445f-a587-651af3f86087 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:50.533672 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-496d0bd7-170e-445f-a587-651af3f86087 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] 10.222.0.23 "GET /compute/v2.1/servers/11fefdc7-238f-4580-96f8-d4ba861abeea/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.127371 Sep 09 16:35:50.534264 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 272/544] 10.222.0.23 () {58 vars in 1275 bytes} [Fri Sep 9 16:35:50 2022] GET /compute/v2.1/servers/11fefdc7-238f-4580-96f8-d4ba861abeea/os-interface => generated 284 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:35:50.579447 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-12e61755-af5e-4943-8bbd-4cd80e739bc4 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:50.588467 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-12e61755-af5e-4943-8bbd-4cd80e739bc4 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:50.589932 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-12e61755-af5e-4943-8bbd-4cd80e739bc4 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:50.591152 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-12e61755-af5e-4943-8bbd-4cd80e739bc4 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf" status: 200 len: 1808 microversion: 2.20 time: 0.203205 Sep 09 16:35:50.591689 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 273/545] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Sep 9 16:35:50 2022] GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf => generated 1808 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 16:35:51.409503 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-21caf7b9-244b-4522-bf7c-7f0e516efcbb tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:35:51.419270 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-21caf7b9-244b-4522-bf7c-7f0e516efcbb tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: 994c3400-0024-457d-88c7-e59b4053062c] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:35:51.425975 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-21caf7b9-244b-4522-bf7c-7f0e516efcbb tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:51.426617 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-21caf7b9-244b-4522-bf7c-7f0e516efcbb tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:51.427368 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-21caf7b9-244b-4522-bf7c-7f0e516efcbb tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:51.428259 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-21caf7b9-244b-4522-bf7c-7f0e516efcbb tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:51.428925 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-21caf7b9-244b-4522-bf7c-7f0e516efcbb tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:51.429489 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-21caf7b9-244b-4522-bf7c-7f0e516efcbb tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:51.478612 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [req-d6a2f444-97d9-4d35-ab10-274475dae321 req-3255cf0e-572b-4da5-82f6-34fe71b6f273 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11fefdc7-238f-4580-96f8-d4ba861abeea", "tag": "c4a63018-5377-450a-9b13-cab181f1fd22"}]} {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:35:51.491535 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [req-d6a2f444-97d9-4d35-ab10-274475dae321 req-3255cf0e-572b-4da5-82f6-34fe71b6f273 service nova] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:51.492358 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [req-d6a2f444-97d9-4d35-ab10-274475dae321 req-3255cf0e-572b-4da5-82f6-34fe71b6f273 service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:51.493631 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [req-d6a2f444-97d9-4d35-ab10-274475dae321 req-3255cf0e-572b-4da5-82f6-34fe71b6f273 service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:51.506352 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.compute.server_external_events [req-d6a2f444-97d9-4d35-ab10-274475dae321 req-3255cf0e-572b-4da5-82f6-34fe71b6f273 service nova] Creating event network-changed:c4a63018-5377-450a-9b13-cab181f1fd22 for instance 11fefdc7-238f-4580-96f8-d4ba861abeea on hv-cinder-83124 Sep 09 16:35:51.512347 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [req-d6a2f444-97d9-4d35-ab10-274475dae321 req-3255cf0e-572b-4da5-82f6-34fe71b6f273 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037713 Sep 09 16:35:51.513564 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 274/546] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Sep 9 16:35:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:35:51.617368 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-20e9e7b2-5642-4dc3-a09c-a1494e3cf9ae tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:35:51.618058 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-20e9e7b2-5642-4dc3-a09c-a1494e3cf9ae tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: 27b503a6-c023-49fb-b11a-37da810939cf] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:35:51.623241 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-21caf7b9-244b-4522-bf7c-7f0e516efcbb tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d86f09c6304121be2021cb5c15e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ab544d0b547919794e3efb49ba0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:51.637970 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-21caf7b9-244b-4522-bf7c-7f0e516efcbb tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/994c3400-0024-457d-88c7-e59b4053062c" status: 200 len: 1714 microversion: 2.1 time: 0.232388 Sep 09 16:35:51.651638 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 273/547] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:35:51 2022] GET /compute/v2.1/servers/994c3400-0024-457d-88c7-e59b4053062c => generated 1714 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:35:51.651750 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-20e9e7b2-5642-4dc3-a09c-a1494e3cf9ae tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:51.651750 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-20e9e7b2-5642-4dc3-a09c-a1494e3cf9ae tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:51.651750 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-20e9e7b2-5642-4dc3-a09c-a1494e3cf9ae tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:51.651750 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-20e9e7b2-5642-4dc3-a09c-a1494e3cf9ae tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:51.652098 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-20e9e7b2-5642-4dc3-a09c-a1494e3cf9ae tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:51.652098 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-20e9e7b2-5642-4dc3-a09c-a1494e3cf9ae tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:51.765400 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-eac9ddc8-0723-4723-b5d1-058f6b5c2a4c tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:35:51.765894 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-eac9ddc8-0723-4723-b5d1-058f6b5c2a4c tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: 994c3400-0024-457d-88c7-e59b4053062c] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:35:51.772315 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-eac9ddc8-0723-4723-b5d1-058f6b5c2a4c tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:51.772799 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-eac9ddc8-0723-4723-b5d1-058f6b5c2a4c tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:51.773488 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-eac9ddc8-0723-4723-b5d1-058f6b5c2a4c tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:51.774224 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-eac9ddc8-0723-4723-b5d1-058f6b5c2a4c tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:51.774739 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-eac9ddc8-0723-4723-b5d1-058f6b5c2a4c tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:51.775240 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-eac9ddc8-0723-4723-b5d1-058f6b5c2a4c tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:51.867562 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.wsgi [None req-eac9ddc8-0723-4723-b5d1-058f6b5c2a4c tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] HTTP exception thrown: Cannot 'detach_volume' instance 994c3400-0024-457d-88c7-e59b4053062c while it is in vm_state rescued Sep 09 16:35:51.869203 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-eac9ddc8-0723-4723-b5d1-058f6b5c2a4c tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Request method failure captured: Sep 09 16:35:51.869203 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: request: DELETE /compute/v2.1/servers/994c3400-0024-457d-88c7-e59b4053062c/os-volume_attachments/e1770aee-0b7f-44de-978d-9ab570bdb3ad HTTP/1.1 Sep 09 16:35:51.869203 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Accept: application/json Sep 09 16:35:51.869203 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Accept-Encoding: identity Sep 09 16:35:51.869203 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Connection: close Sep 09 16:35:51.869203 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Content-Length: 0 Sep 09 16:35:51.869203 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Content-Type: application/json Sep 09 16:35:51.869203 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Host: 10.222.0.23 Sep 09 16:35:51.869203 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Openstack-System-Scope: None Sep 09 16:35:51.869203 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: User-Agent: python-urllib3/1.26.12 Sep 09 16:35:51.869203 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Auth-Token: gAAAAABjG2p-0YVzE1C54y4YHzerR9fl8ogYekOzuznZ1bfrL9kUVfW6Ih02eq7nOq40QjAAw9fvfdATGoMCwd4vVva2idcU68ciSkDoKd8Q2lSb22phiMWNOP_KzlG5zPAX_USx2tS2bKk8URzwp5NdlHntDfA3_G1B81ZhfjolUxo8_fp6MfY Sep 09 16:35:51.869203 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Domain-Id: None Sep 09 16:35:51.869203 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Domain-Name: None Sep 09 16:35:51.869203 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Identity-Status: Confirmed Sep 09 16:35:51.869203 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Is-Admin-Project: True Sep 09 16:35:51.869203 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Project-Domain-Id: default Sep 09 16:35:51.869203 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Project-Domain-Name: Default Sep 09 16:35:51.869203 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Project-Id: d21ab544d0b547919794e3efb49ba0e9 Sep 09 16:35:51.869203 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1054417282 Sep 09 16:35:51.869203 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Role: member,reader Sep 09 16:35:51.869203 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Roles: member,reader Sep 09 16:35:51.870565 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d21ab544d0b547919794e3efb49ba0e9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d21ab544d0b547919794e3efb49ba0e9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d21ab544d0b547919794e3efb49ba0e9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d21ab544d0b547919794e3efb49ba0e9"}]}] Sep 09 16:35:51.870565 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1054417282 Sep 09 16:35:51.870565 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Tenant-Id: d21ab544d0b547919794e3efb49ba0e9 Sep 09 16:35:51.870565 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1054417282 Sep 09 16:35:51.870565 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User: tempest-ServerRescueNegativeTestJSON-1054417282-project Sep 09 16:35:51.870565 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User-Domain-Id: default Sep 09 16:35:51.870565 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User-Domain-Name: Default Sep 09 16:35:51.870565 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User-Id: 67d86f09c6304121be2021cb5c15e63e Sep 09 16:35:51.870565 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1054417282-project Sep 09 16:35:51.870565 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: method: > Sep 09 16:35:51.870565 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: exception: Cannot 'detach_volume' instance 994c3400-0024-457d-88c7-e59b4053062c while it is in vm_state rescued Sep 09 16:35:51.871240 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: action_args: {'server_id': '994c3400-0024-457d-88c7-e59b4053062c', 'id': 'e1770aee-0b7f-44de-978d-9ab570bdb3ad'} Sep 09 16:35:51.871240 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 16:35:51.871240 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:35:51.871240 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 09 16:35:51.871240 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 09 16:35:51.871240 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 09 16:35:51.871240 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 09 16:35:51.871240 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 09 16:35:51.871240 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 09 16:35:51.871240 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 994c3400-0024-457d-88c7-e59b4053062c in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 09 16:35:51.871240 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:35:51.871240 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 16:35:51.871240 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:35:51.871240 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:35:51.871240 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 16:35:51.871240 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 16:35:51.871240 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 16:35:51.871240 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 16:35:51.871240 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 16:35:51.871240 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 16:35:51.873376 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 09 16:35:51.873376 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 09 16:35:51.873376 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 09 16:35:51.873376 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 09 16:35:51.873376 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 994c3400-0024-457d-88c7-e59b4053062c while it is in vm_state rescued Sep 09 16:35:51.873376 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:35:51.873376 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 16:35:51.873376 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:35:51.873376 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:35:51.873376 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 16:35:51.873376 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 16:35:51.873376 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 16:35:51.873376 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 16:35:51.873376 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 994c3400-0024-457d-88c7-e59b4053062c while it is in vm_state rescued Sep 09 16:35:51.873376 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:35:51.873376 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-eac9ddc8-0723-4723-b5d1-058f6b5c2a4c tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Returning 409 to user: Cannot 'detach_volume' instance 994c3400-0024-457d-88c7-e59b4053062c while it is in vm_state rescued {{(pid=127198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 16:35:51.874742 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-eac9ddc8-0723-4723-b5d1-058f6b5c2a4c tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "DELETE /compute/v2.1/servers/994c3400-0024-457d-88c7-e59b4053062c/os-volume_attachments/e1770aee-0b7f-44de-978d-9ab570bdb3ad" status: 409 len: 152 microversion: 2.1 time: 0.109477 Sep 09 16:35:51.874742 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 274/548] 10.222.0.23 () {58 vars in 1416 bytes} [Fri Sep 9 16:35:51 2022] DELETE /compute/v2.1/servers/994c3400-0024-457d-88c7-e59b4053062c/os-volume_attachments/e1770aee-0b7f-44de-978d-9ab570bdb3ad => generated 152 bytes in 111 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 09 16:35:51.879533 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-7f21ef10-d71d-484e-bece-f0550d11b812 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:35:51.880160 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-7f21ef10-d71d-484e-bece-f0550d11b812 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: 994c3400-0024-457d-88c7-e59b4053062c] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:35:51.887635 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7f21ef10-d71d-484e-bece-f0550d11b812 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:51.888212 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7f21ef10-d71d-484e-bece-f0550d11b812 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:51.888694 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7f21ef10-d71d-484e-bece-f0550d11b812 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:51.889451 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7f21ef10-d71d-484e-bece-f0550d11b812 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:51.889968 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7f21ef10-d71d-484e-bece-f0550d11b812 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:51.890452 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7f21ef10-d71d-484e-bece-f0550d11b812 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:51.921367 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-20e9e7b2-5642-4dc3-a09c-a1494e3cf9ae tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:51.930369 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-20e9e7b2-5642-4dc3-a09c-a1494e3cf9ae tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:51.931934 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-20e9e7b2-5642-4dc3-a09c-a1494e3cf9ae tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:51.933178 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-20e9e7b2-5642-4dc3-a09c-a1494e3cf9ae tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf" status: 200 len: 1808 microversion: 2.20 time: 0.320094 Sep 09 16:35:51.933821 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 275/549] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Sep 9 16:35:51 2022] GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf => generated 1808 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 16:35:51.960362 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-7f21ef10-d71d-484e-bece-f0550d11b812 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "POST /compute/v2.1/servers/994c3400-0024-457d-88c7-e59b4053062c/action" status: 202 len: 0 microversion: 2.1 time: 0.084299 Sep 09 16:35:51.961030 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 275/550] 10.222.0.23 () {60 vars in 1278 bytes} [Fri Sep 9 16:35:51 2022] POST /compute/v2.1/servers/994c3400-0024-457d-88c7-e59b4053062c/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 09 16:35:51.969782 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-294dd00b-bb69-4e84-9775-00c727e04f72 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:35:51.970488 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-294dd00b-bb69-4e84-9775-00c727e04f72 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: 994c3400-0024-457d-88c7-e59b4053062c] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:35:51.977822 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-294dd00b-bb69-4e84-9775-00c727e04f72 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:51.978322 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-294dd00b-bb69-4e84-9775-00c727e04f72 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:51.978777 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-294dd00b-bb69-4e84-9775-00c727e04f72 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:51.979476 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-294dd00b-bb69-4e84-9775-00c727e04f72 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:51.979984 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-294dd00b-bb69-4e84-9775-00c727e04f72 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:51.980400 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-294dd00b-bb69-4e84-9775-00c727e04f72 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:52.116667 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-294dd00b-bb69-4e84-9775-00c727e04f72 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d86f09c6304121be2021cb5c15e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ab544d0b547919794e3efb49ba0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:52.125496 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-294dd00b-bb69-4e84-9775-00c727e04f72 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/994c3400-0024-457d-88c7-e59b4053062c" status: 200 len: 1722 microversion: 2.1 time: 0.160081 Sep 09 16:35:52.126194 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 276/551] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:35:51 2022] GET /compute/v2.1/servers/994c3400-0024-457d-88c7-e59b4053062c => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:35:52.966112 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-f1951299-8cf1-4309-89a3-9b18ce0eaebd tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:35:52.967296 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-f1951299-8cf1-4309-89a3-9b18ce0eaebd tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: 27b503a6-c023-49fb-b11a-37da810939cf] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:35:52.977888 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f1951299-8cf1-4309-89a3-9b18ce0eaebd tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:52.978753 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f1951299-8cf1-4309-89a3-9b18ce0eaebd tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:52.979475 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f1951299-8cf1-4309-89a3-9b18ce0eaebd tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:52.980601 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f1951299-8cf1-4309-89a3-9b18ce0eaebd tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:52.981352 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f1951299-8cf1-4309-89a3-9b18ce0eaebd tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:52.982063 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f1951299-8cf1-4309-89a3-9b18ce0eaebd tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:53.130936 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-f1951299-8cf1-4309-89a3-9b18ce0eaebd tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:53.140335 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-f1951299-8cf1-4309-89a3-9b18ce0eaebd tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:53.141795 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-f1951299-8cf1-4309-89a3-9b18ce0eaebd tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:53.143636 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-f1951299-8cf1-4309-89a3-9b18ce0eaebd tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf" status: 200 len: 1808 microversion: 2.20 time: 0.185189 Sep 09 16:35:53.144792 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 276/552] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Sep 9 16:35:52 2022] GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf => generated 1808 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 16:35:53.149668 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-ff9044d0-397d-4ce7-9808-16eec1b8fbc6 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:35:53.150270 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-ff9044d0-397d-4ce7-9808-16eec1b8fbc6 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: 994c3400-0024-457d-88c7-e59b4053062c] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:35:53.156835 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-ff9044d0-397d-4ce7-9808-16eec1b8fbc6 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:53.157162 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-ff9044d0-397d-4ce7-9808-16eec1b8fbc6 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:53.157629 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-ff9044d0-397d-4ce7-9808-16eec1b8fbc6 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:53.158369 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-ff9044d0-397d-4ce7-9808-16eec1b8fbc6 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:53.159015 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-ff9044d0-397d-4ce7-9808-16eec1b8fbc6 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:53.159491 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-ff9044d0-397d-4ce7-9808-16eec1b8fbc6 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:53.395109 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-ff9044d0-397d-4ce7-9808-16eec1b8fbc6 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d86f09c6304121be2021cb5c15e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ab544d0b547919794e3efb49ba0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:53.404163 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-ff9044d0-397d-4ce7-9808-16eec1b8fbc6 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/994c3400-0024-457d-88c7-e59b4053062c" status: 200 len: 1722 microversion: 2.1 time: 0.258904 Sep 09 16:35:53.404726 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 277/553] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:35:53 2022] GET /compute/v2.1/servers/994c3400-0024-457d-88c7-e59b4053062c => generated 1722 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:35:54.171690 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-bbaab28d-310b-481a-af95-7d66c8efebfa tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:35:54.172273 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-bbaab28d-310b-481a-af95-7d66c8efebfa tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: 27b503a6-c023-49fb-b11a-37da810939cf] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:35:54.178807 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-bbaab28d-310b-481a-af95-7d66c8efebfa tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:54.179285 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-bbaab28d-310b-481a-af95-7d66c8efebfa tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:54.179712 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-bbaab28d-310b-481a-af95-7d66c8efebfa tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:54.180389 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-bbaab28d-310b-481a-af95-7d66c8efebfa tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:54.180839 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-bbaab28d-310b-481a-af95-7d66c8efebfa tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:54.181256 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-bbaab28d-310b-481a-af95-7d66c8efebfa tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:54.312485 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-bbaab28d-310b-481a-af95-7d66c8efebfa tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:54.321810 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-bbaab28d-310b-481a-af95-7d66c8efebfa tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:54.323304 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-bbaab28d-310b-481a-af95-7d66c8efebfa tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:54.324449 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-bbaab28d-310b-481a-af95-7d66c8efebfa tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf" status: 200 len: 1808 microversion: 2.20 time: 0.157112 Sep 09 16:35:54.324995 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 277/554] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Sep 9 16:35:54 2022] GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 16:35:54.432825 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-c5a35ab1-f341-4ade-b810-674248d8a323 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:35:54.433824 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-c5a35ab1-f341-4ade-b810-674248d8a323 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: 994c3400-0024-457d-88c7-e59b4053062c] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:35:54.444562 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-c5a35ab1-f341-4ade-b810-674248d8a323 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:54.445357 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-c5a35ab1-f341-4ade-b810-674248d8a323 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:54.446079 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-c5a35ab1-f341-4ade-b810-674248d8a323 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:54.447446 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-c5a35ab1-f341-4ade-b810-674248d8a323 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:54.448215 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-c5a35ab1-f341-4ade-b810-674248d8a323 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:54.448910 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-c5a35ab1-f341-4ade-b810-674248d8a323 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:54.597652 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-c5a35ab1-f341-4ade-b810-674248d8a323 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d86f09c6304121be2021cb5c15e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ab544d0b547919794e3efb49ba0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:54.606003 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-c5a35ab1-f341-4ade-b810-674248d8a323 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/994c3400-0024-457d-88c7-e59b4053062c" status: 200 len: 1722 microversion: 2.1 time: 0.180139 Sep 09 16:35:54.606598 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 278/555] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:35:54 2022] GET /compute/v2.1/servers/994c3400-0024-457d-88c7-e59b4053062c => generated 1722 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:35:55.353616 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-382e027d-1190-42b2-a65b-5e97750a7086 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:35:55.354623 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-382e027d-1190-42b2-a65b-5e97750a7086 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: 27b503a6-c023-49fb-b11a-37da810939cf] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:35:55.365510 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-382e027d-1190-42b2-a65b-5e97750a7086 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:55.366312 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-382e027d-1190-42b2-a65b-5e97750a7086 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:55.367084 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-382e027d-1190-42b2-a65b-5e97750a7086 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:55.367778 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-382e027d-1190-42b2-a65b-5e97750a7086 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:55.368225 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-382e027d-1190-42b2-a65b-5e97750a7086 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:55.368649 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-382e027d-1190-42b2-a65b-5e97750a7086 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:55.505991 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-382e027d-1190-42b2-a65b-5e97750a7086 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:55.515288 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-382e027d-1190-42b2-a65b-5e97750a7086 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:55.516746 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-382e027d-1190-42b2-a65b-5e97750a7086 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:55.517896 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-382e027d-1190-42b2-a65b-5e97750a7086 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf" status: 200 len: 1808 microversion: 2.20 time: 0.171010 Sep 09 16:35:55.518560 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 278/556] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Sep 9 16:35:55 2022] GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf => generated 1808 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 16:35:55.629335 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-0197af97-584a-4a1a-9fe1-29a1b70ecc08 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:35:55.630133 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-0197af97-584a-4a1a-9fe1-29a1b70ecc08 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: 994c3400-0024-457d-88c7-e59b4053062c] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:35:55.636660 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-0197af97-584a-4a1a-9fe1-29a1b70ecc08 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:55.637138 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-0197af97-584a-4a1a-9fe1-29a1b70ecc08 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:55.637566 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-0197af97-584a-4a1a-9fe1-29a1b70ecc08 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:55.638249 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-0197af97-584a-4a1a-9fe1-29a1b70ecc08 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:55.638724 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-0197af97-584a-4a1a-9fe1-29a1b70ecc08 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:55.639163 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-0197af97-584a-4a1a-9fe1-29a1b70ecc08 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:55.766378 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-0197af97-584a-4a1a-9fe1-29a1b70ecc08 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d86f09c6304121be2021cb5c15e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ab544d0b547919794e3efb49ba0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:55.775336 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-0197af97-584a-4a1a-9fe1-29a1b70ecc08 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/994c3400-0024-457d-88c7-e59b4053062c" status: 200 len: 1722 microversion: 2.1 time: 0.149828 Sep 09 16:35:55.775877 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 279/557] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:35:55 2022] GET /compute/v2.1/servers/994c3400-0024-457d-88c7-e59b4053062c => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:35:56.543537 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-88b9cd03-7d39-4158-8cd3-ec08cbaf4af1 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:35:56.544150 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-88b9cd03-7d39-4158-8cd3-ec08cbaf4af1 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: 27b503a6-c023-49fb-b11a-37da810939cf] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:35:56.550996 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-88b9cd03-7d39-4158-8cd3-ec08cbaf4af1 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:56.551480 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-88b9cd03-7d39-4158-8cd3-ec08cbaf4af1 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:56.551909 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-88b9cd03-7d39-4158-8cd3-ec08cbaf4af1 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:56.552570 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-88b9cd03-7d39-4158-8cd3-ec08cbaf4af1 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:56.553214 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-88b9cd03-7d39-4158-8cd3-ec08cbaf4af1 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:56.553601 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-88b9cd03-7d39-4158-8cd3-ec08cbaf4af1 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:56.572309 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:35:56.697154 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [req-5cf1866e-c3cd-4d5e-9b5f-77b37291ffab req-39cd4350-d27b-4517-a003-53a833cd9119 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27b503a6-c023-49fb-b11a-37da810939cf", "name": "network-vif-plugged", "status": "completed", "tag": "56079a62-4748-409c-b913-eb3925499a09"}]} {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:35:56.698603 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-88b9cd03-7d39-4158-8cd3-ec08cbaf4af1 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:56.708100 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-88b9cd03-7d39-4158-8cd3-ec08cbaf4af1 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:56.709574 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-88b9cd03-7d39-4158-8cd3-ec08cbaf4af1 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:56.711166 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-88b9cd03-7d39-4158-8cd3-ec08cbaf4af1 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf" status: 200 len: 1808 microversion: 2.20 time: 0.172040 Sep 09 16:35:56.712045 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 279/558] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Sep 9 16:35:56 2022] GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf => generated 1808 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 16:35:56.719682 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [req-5cf1866e-c3cd-4d5e-9b5f-77b37291ffab req-39cd4350-d27b-4517-a003-53a833cd9119 service nova] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:56.720504 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [req-5cf1866e-c3cd-4d5e-9b5f-77b37291ffab req-39cd4350-d27b-4517-a003-53a833cd9119 service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:56.721255 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [req-5cf1866e-c3cd-4d5e-9b5f-77b37291ffab req-39cd4350-d27b-4517-a003-53a833cd9119 service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:56.729946 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-cb7dc61d-074b-469f-a12d-cbc6dec8eee0 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-998086518", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1912061220", "security_groups": [{"name": "tempest-secgroup-smoke-1395349735"}], "networks": [{"uuid": "8994f13d-6dfa-4b3f-8b8f-29ba3da4f759"}], "block_device_mapping_v2": [{"uuid": "a15e9ff4-55d7-4899-bf89-7382714a65ac", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:35:56.743084 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.compute.server_external_events [req-5cf1866e-c3cd-4d5e-9b5f-77b37291ffab req-39cd4350-d27b-4517-a003-53a833cd9119 service nova] Creating event network-vif-plugged:56079a62-4748-409c-b913-eb3925499a09 for instance 27b503a6-c023-49fb-b11a-37da810939cf on hv-cinder-83124 Sep 09 16:35:56.748510 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [req-5cf1866e-c3cd-4d5e-9b5f-77b37291ffab req-39cd4350-d27b-4517-a003-53a833cd9119 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055616 Sep 09 16:35:56.749386 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 280/559] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Sep 9 16:35:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 16:35:56.805430 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-fced9804-74f1-4547-8001-64f75a874c56 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:35:56.806330 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-fced9804-74f1-4547-8001-64f75a874c56 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: 994c3400-0024-457d-88c7-e59b4053062c] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:35:56.816051 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-fced9804-74f1-4547-8001-64f75a874c56 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:56.816545 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-fced9804-74f1-4547-8001-64f75a874c56 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:56.816977 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-fced9804-74f1-4547-8001-64f75a874c56 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:56.817672 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-fced9804-74f1-4547-8001-64f75a874c56 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:56.818592 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-fced9804-74f1-4547-8001-64f75a874c56 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:56.818592 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-fced9804-74f1-4547-8001-64f75a874c56 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:56.857038 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.network.neutron [None req-cb7dc61d-074b-469f-a12d-cbc6dec8eee0 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] validate_networks() for [('8994f13d-6dfa-4b3f-8b8f-29ba3da4f759', None, None, None, None, None)] {{(pid=127198) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 16:35:57.035199 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-fced9804-74f1-4547-8001-64f75a874c56 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d86f09c6304121be2021cb5c15e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ab544d0b547919794e3efb49ba0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:57.046047 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-fced9804-74f1-4547-8001-64f75a874c56 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/994c3400-0024-457d-88c7-e59b4053062c" status: 200 len: 1728 microversion: 2.1 time: 0.245679 Sep 09 16:35:57.046670 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 281/560] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:35:56 2022] GET /compute/v2.1/servers/994c3400-0024-457d-88c7-e59b4053062c => generated 1728 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:35:57.070712 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-3c6e3cb7-7c81-4d03-892e-869aecb15686 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:35:57.071280 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-3c6e3cb7-7c81-4d03-892e-869aecb15686 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: 994c3400-0024-457d-88c7-e59b4053062c] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:35:57.077611 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-3c6e3cb7-7c81-4d03-892e-869aecb15686 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:57.078101 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-3c6e3cb7-7c81-4d03-892e-869aecb15686 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:57.078558 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-3c6e3cb7-7c81-4d03-892e-869aecb15686 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:57.079271 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-3c6e3cb7-7c81-4d03-892e-869aecb15686 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:57.079740 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-3c6e3cb7-7c81-4d03-892e-869aecb15686 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:57.080152 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-3c6e3cb7-7c81-4d03-892e-869aecb15686 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:57.208306 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-3c6e3cb7-7c81-4d03-892e-869aecb15686 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/994c3400-0024-457d-88c7-e59b4053062c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.143327 Sep 09 16:35:57.208907 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 282/561] 10.222.0.23 () {58 vars in 1275 bytes} [Fri Sep 9 16:35:57 2022] GET /compute/v2.1/servers/994c3400-0024-457d-88c7-e59b4053062c/os-interface => generated 285 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:35:57.397775 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-cb7dc61d-074b-469f-a12d-cbc6dec8eee0 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Flavor limits 0:0:0 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 16:35:57.398276 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-cb7dc61d-074b-469f-a12d-cbc6dec8eee0 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Image limits 0:0:0 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 16:35:57.399016 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-cb7dc61d-074b-469f-a12d-cbc6dec8eee0 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Flavor pref 0:0:0 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 16:35:57.399525 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-cb7dc61d-074b-469f-a12d-cbc6dec8eee0 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Image pref 0:0:0 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 16:35:57.399989 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-cb7dc61d-074b-469f-a12d-cbc6dec8eee0 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 16:35:57.410087 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cb7dc61d-074b-469f-a12d-cbc6dec8eee0 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:57.410627 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cb7dc61d-074b-469f-a12d-cbc6dec8eee0 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:57.411078 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cb7dc61d-074b-469f-a12d-cbc6dec8eee0 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:57.411792 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cb7dc61d-074b-469f-a12d-cbc6dec8eee0 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:57.412235 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cb7dc61d-074b-469f-a12d-cbc6dec8eee0 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:57.412642 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cb7dc61d-074b-469f-a12d-cbc6dec8eee0 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:57.429701 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.quota [None req-cb7dc61d-074b-469f-a12d-cbc6dec8eee0 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Getting quotas for project 1ba803ac5e71467f853215e19a7f8867. Resources: {'cores', 'instances', 'ram'} {{(pid=127198) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 16:35:57.433948 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.quota [None req-cb7dc61d-074b-469f-a12d-cbc6dec8eee0 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Getting quotas for user 208daa6413d34e4496e278fb3fc251a5 and project 1ba803ac5e71467f853215e19a7f8867. Resources: {'cores', 'instances', 'ram'} {{(pid=127198) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 16:35:57.489995 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-cb7dc61d-074b-469f-a12d-cbc6dec8eee0 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Going to run 1 instances... {{(pid=127198) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 16:35:57.492236 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-cb7dc61d-074b-469f-a12d-cbc6dec8eee0 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] [instance: 9bed6256-fc6f-40dd-b465-54981581a6aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a15e9ff4-55d7-4899-bf89-7382714a65ac',volume_size=None,volume_type=None)] {{(pid=127198) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 16:35:57.629258 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-cb7dc61d-074b-469f-a12d-cbc6dec8eee0 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.903720 Sep 09 16:35:57.630636 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 280/562] 10.222.0.23 () {60 vars in 1147 bytes} [Fri Sep 9 16:35:56 2022] POST /compute/v2.1/servers => generated 406 bytes in 906 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 16:35:57.641539 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-8796237a-7c4e-472d-836b-5e11ad649690 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:35:57.642146 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-8796237a-7c4e-472d-836b-5e11ad649690 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] [instance: 9bed6256-fc6f-40dd-b465-54981581a6aa] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:35:57.702940 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-8796237a-7c4e-472d-836b-5e11ad649690 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208daa6413d34e4496e278fb3fc251a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba803ac5e71467f853215e19a7f8867', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:57.710306 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-8796237a-7c4e-472d-836b-5e11ad649690 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] 10.222.0.23 "GET /compute/v2.1/servers/9bed6256-fc6f-40dd-b465-54981581a6aa" status: 200 len: 1088 microversion: 2.1 time: 0.072551 Sep 09 16:35:57.710989 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 283/563] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:35:57 2022] GET /compute/v2.1/servers/9bed6256-fc6f-40dd-b465-54981581a6aa => generated 1088 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:35:57.736709 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-2b354b5d-9a3a-47a4-ae25-813387f9dce6 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:35:57.737323 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-2b354b5d-9a3a-47a4-ae25-813387f9dce6 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: 27b503a6-c023-49fb-b11a-37da810939cf] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:35:57.743745 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2b354b5d-9a3a-47a4-ae25-813387f9dce6 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:57.744228 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2b354b5d-9a3a-47a4-ae25-813387f9dce6 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:57.744667 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2b354b5d-9a3a-47a4-ae25-813387f9dce6 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:57.745360 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2b354b5d-9a3a-47a4-ae25-813387f9dce6 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:57.745807 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2b354b5d-9a3a-47a4-ae25-813387f9dce6 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:57.746379 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2b354b5d-9a3a-47a4-ae25-813387f9dce6 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:57.881515 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-2b354b5d-9a3a-47a4-ae25-813387f9dce6 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:57.898581 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-2b354b5d-9a3a-47a4-ae25-813387f9dce6 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:57.900062 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-2b354b5d-9a3a-47a4-ae25-813387f9dce6 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:57.901232 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-2b354b5d-9a3a-47a4-ae25-813387f9dce6 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf" status: 200 len: 1808 microversion: 2.20 time: 0.168553 Sep 09 16:35:57.901815 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 281/564] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Sep 9 16:35:57 2022] GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 16:35:58.250757 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [req-48216163-82b3-4947-9ec6-d4d70129f2a7 req-a3adc4ef-2ee5-42ef-9cb2-c2a342a4099d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "994c3400-0024-457d-88c7-e59b4053062c", "tag": "cd3987cc-b23d-4fa7-bf49-6afa802d4f4a"}]} {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:35:58.261935 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [req-48216163-82b3-4947-9ec6-d4d70129f2a7 req-a3adc4ef-2ee5-42ef-9cb2-c2a342a4099d service nova] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:58.262711 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [req-48216163-82b3-4947-9ec6-d4d70129f2a7 req-a3adc4ef-2ee5-42ef-9cb2-c2a342a4099d service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:58.263310 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [req-48216163-82b3-4947-9ec6-d4d70129f2a7 req-a3adc4ef-2ee5-42ef-9cb2-c2a342a4099d service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:58.274963 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.compute.server_external_events [req-48216163-82b3-4947-9ec6-d4d70129f2a7 req-a3adc4ef-2ee5-42ef-9cb2-c2a342a4099d service nova] Creating event network-changed:cd3987cc-b23d-4fa7-bf49-6afa802d4f4a for instance 994c3400-0024-457d-88c7-e59b4053062c on hv-cinder-83124 Sep 09 16:35:58.283501 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [req-48216163-82b3-4947-9ec6-d4d70129f2a7 req-a3adc4ef-2ee5-42ef-9cb2-c2a342a4099d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036560 Sep 09 16:35:58.284120 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 284/565] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Sep 9 16:35:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:35:58.733649 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-57c11fc6-6d18-455a-a387-3882c4145aef tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:35:58.734251 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-57c11fc6-6d18-455a-a387-3882c4145aef tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] [instance: 9bed6256-fc6f-40dd-b465-54981581a6aa] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:35:58.741308 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-57c11fc6-6d18-455a-a387-3882c4145aef tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:58.741798 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-57c11fc6-6d18-455a-a387-3882c4145aef tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:58.742234 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-57c11fc6-6d18-455a-a387-3882c4145aef tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:58.742974 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-57c11fc6-6d18-455a-a387-3882c4145aef tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:58.743429 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-57c11fc6-6d18-455a-a387-3882c4145aef tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:58.743856 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-57c11fc6-6d18-455a-a387-3882c4145aef tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:58.807139 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-57c11fc6-6d18-455a-a387-3882c4145aef tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208daa6413d34e4496e278fb3fc251a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba803ac5e71467f853215e19a7f8867', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:58.815290 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-57c11fc6-6d18-455a-a387-3882c4145aef tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] 10.222.0.23 "GET /compute/v2.1/servers/9bed6256-fc6f-40dd-b465-54981581a6aa" status: 200 len: 1186 microversion: 2.1 time: 0.085559 Sep 09 16:35:58.815865 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 282/566] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:35:58 2022] GET /compute/v2.1/servers/9bed6256-fc6f-40dd-b465-54981581a6aa => generated 1186 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:35:58.929413 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-72bc49e6-62ab-4cb9-bd1f-b9fe0461f63d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:35:58.930203 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-72bc49e6-62ab-4cb9-bd1f-b9fe0461f63d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: 27b503a6-c023-49fb-b11a-37da810939cf] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:35:58.936585 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-72bc49e6-62ab-4cb9-bd1f-b9fe0461f63d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:58.937058 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-72bc49e6-62ab-4cb9-bd1f-b9fe0461f63d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:58.937480 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-72bc49e6-62ab-4cb9-bd1f-b9fe0461f63d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:58.938163 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-72bc49e6-62ab-4cb9-bd1f-b9fe0461f63d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:58.938668 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-72bc49e6-62ab-4cb9-bd1f-b9fe0461f63d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:58.939066 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-72bc49e6-62ab-4cb9-bd1f-b9fe0461f63d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:59.078670 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-72bc49e6-62ab-4cb9-bd1f-b9fe0461f63d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:59.094294 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-72bc49e6-62ab-4cb9-bd1f-b9fe0461f63d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:59.098403 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-72bc49e6-62ab-4cb9-bd1f-b9fe0461f63d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:59.101001 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-72bc49e6-62ab-4cb9-bd1f-b9fe0461f63d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf" status: 200 len: 1808 microversion: 2.20 time: 0.176497 Sep 09 16:35:59.103208 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 285/567] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Sep 9 16:35:58 2022] GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf => generated 1808 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 16:35:59.838353 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-64c74227-5f4b-4c8b-b8d3-df24fac01880 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:35:59.839629 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-64c74227-5f4b-4c8b-b8d3-df24fac01880 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] [instance: 9bed6256-fc6f-40dd-b465-54981581a6aa] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:35:59.846051 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-64c74227-5f4b-4c8b-b8d3-df24fac01880 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:59.846553 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-64c74227-5f4b-4c8b-b8d3-df24fac01880 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:59.846983 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-64c74227-5f4b-4c8b-b8d3-df24fac01880 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:59.847664 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-64c74227-5f4b-4c8b-b8d3-df24fac01880 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:35:59.848276 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-64c74227-5f4b-4c8b-b8d3-df24fac01880 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:35:59.848689 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-64c74227-5f4b-4c8b-b8d3-df24fac01880 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:35:59.924242 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-64c74227-5f4b-4c8b-b8d3-df24fac01880 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208daa6413d34e4496e278fb3fc251a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba803ac5e71467f853215e19a7f8867', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:35:59.932542 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-64c74227-5f4b-4c8b-b8d3-df24fac01880 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] 10.222.0.23 "GET /compute/v2.1/servers/9bed6256-fc6f-40dd-b465-54981581a6aa" status: 200 len: 1204 microversion: 2.1 time: 0.098197 Sep 09 16:35:59.933110 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 283/568] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:35:59 2022] GET /compute/v2.1/servers/9bed6256-fc6f-40dd-b465-54981581a6aa => generated 1204 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:36:00.127796 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-34f5d992-92ef-4279-934f-c7d6144d0ccb tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:36:00.129387 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-34f5d992-92ef-4279-934f-c7d6144d0ccb tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: 27b503a6-c023-49fb-b11a-37da810939cf] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:36:00.136156 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-34f5d992-92ef-4279-934f-c7d6144d0ccb tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:00.136632 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-34f5d992-92ef-4279-934f-c7d6144d0ccb tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:00.137066 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-34f5d992-92ef-4279-934f-c7d6144d0ccb tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:00.137799 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-34f5d992-92ef-4279-934f-c7d6144d0ccb tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:00.138217 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-34f5d992-92ef-4279-934f-c7d6144d0ccb tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:00.138664 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-34f5d992-92ef-4279-934f-c7d6144d0ccb tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:00.301859 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [req-c1240c21-a7f0-4c4f-900e-898acb9b6625 req-1d8b39fc-6546-47f3-903b-cf5767a37ff9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "994c3400-0024-457d-88c7-e59b4053062c", "tag": "cd3987cc-b23d-4fa7-bf49-6afa802d4f4a"}]} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:36:00.313033 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-c1240c21-a7f0-4c4f-900e-898acb9b6625 req-1d8b39fc-6546-47f3-903b-cf5767a37ff9 service nova] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:00.313524 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-c1240c21-a7f0-4c4f-900e-898acb9b6625 req-1d8b39fc-6546-47f3-903b-cf5767a37ff9 service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:00.313924 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-c1240c21-a7f0-4c4f-900e-898acb9b6625 req-1d8b39fc-6546-47f3-903b-cf5767a37ff9 service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:00.327720 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.compute.server_external_events [req-c1240c21-a7f0-4c4f-900e-898acb9b6625 req-1d8b39fc-6546-47f3-903b-cf5767a37ff9 service nova] Creating event network-changed:cd3987cc-b23d-4fa7-bf49-6afa802d4f4a for instance 994c3400-0024-457d-88c7-e59b4053062c on hv-cinder-83124 Sep 09 16:36:00.332765 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [req-c1240c21-a7f0-4c4f-900e-898acb9b6625 req-1d8b39fc-6546-47f3-903b-cf5767a37ff9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037084 Sep 09 16:36:00.333365 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 284/569] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Sep 9 16:36:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:36:00.344757 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-34f5d992-92ef-4279-934f-c7d6144d0ccb tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:36:00.353806 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-34f5d992-92ef-4279-934f-c7d6144d0ccb tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:36:00.355384 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-34f5d992-92ef-4279-934f-c7d6144d0ccb tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:36:00.356579 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-34f5d992-92ef-4279-934f-c7d6144d0ccb tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf" status: 200 len: 1795 microversion: 2.20 time: 0.233003 Sep 09 16:36:00.357139 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 286/570] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Sep 9 16:36:00 2022] GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf => generated 1795 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 16:36:00.957696 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-360eed81-39b6-4529-a543-1408fc6b8a90 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:36:00.958413 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-360eed81-39b6-4529-a543-1408fc6b8a90 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] [instance: 9bed6256-fc6f-40dd-b465-54981581a6aa] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:36:00.965714 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-360eed81-39b6-4529-a543-1408fc6b8a90 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:00.966291 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-360eed81-39b6-4529-a543-1408fc6b8a90 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:00.966826 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-360eed81-39b6-4529-a543-1408fc6b8a90 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:00.967627 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-360eed81-39b6-4529-a543-1408fc6b8a90 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:00.968144 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-360eed81-39b6-4529-a543-1408fc6b8a90 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:00.968566 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-360eed81-39b6-4529-a543-1408fc6b8a90 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:01.199468 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-360eed81-39b6-4529-a543-1408fc6b8a90 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208daa6413d34e4496e278fb3fc251a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba803ac5e71467f853215e19a7f8867', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:36:01.208778 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-360eed81-39b6-4529-a543-1408fc6b8a90 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] 10.222.0.23 "GET /compute/v2.1/servers/9bed6256-fc6f-40dd-b465-54981581a6aa" status: 200 len: 1260 microversion: 2.1 time: 0.255255 Sep 09 16:36:01.209450 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 285/571] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:36:00 2022] GET /compute/v2.1/servers/9bed6256-fc6f-40dd-b465-54981581a6aa => generated 1260 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:36:01.435484 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [req-db09fd6c-5350-4814-b99a-402bb75a2f80 req-90679631-e4e5-4f6e-8b09-3b7df7481f98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9bed6256-fc6f-40dd-b465-54981581a6aa", "tag": "7151e062-a48c-4cc1-be6e-dbf4d66de6e4"}]} {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:36:01.448118 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [req-db09fd6c-5350-4814-b99a-402bb75a2f80 req-90679631-e4e5-4f6e-8b09-3b7df7481f98 service nova] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:01.448601 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [req-db09fd6c-5350-4814-b99a-402bb75a2f80 req-90679631-e4e5-4f6e-8b09-3b7df7481f98 service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:01.449007 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [req-db09fd6c-5350-4814-b99a-402bb75a2f80 req-90679631-e4e5-4f6e-8b09-3b7df7481f98 service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:01.460639 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.compute.server_external_events [req-db09fd6c-5350-4814-b99a-402bb75a2f80 req-90679631-e4e5-4f6e-8b09-3b7df7481f98 service nova] Creating event network-changed:7151e062-a48c-4cc1-be6e-dbf4d66de6e4 for instance 9bed6256-fc6f-40dd-b465-54981581a6aa on hv-cinder-83124 Sep 09 16:36:01.465287 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [req-db09fd6c-5350-4814-b99a-402bb75a2f80 req-90679631-e4e5-4f6e-8b09-3b7df7481f98 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033680 Sep 09 16:36:01.465854 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 287/572] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Sep 9 16:36:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:36:02.231815 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-daf0b50d-181d-4533-8213-8adc83f22565 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:36:02.232379 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-daf0b50d-181d-4533-8213-8adc83f22565 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] [instance: 9bed6256-fc6f-40dd-b465-54981581a6aa] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:36:02.239201 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-daf0b50d-181d-4533-8213-8adc83f22565 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:02.239678 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-daf0b50d-181d-4533-8213-8adc83f22565 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:02.240102 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-daf0b50d-181d-4533-8213-8adc83f22565 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:02.240785 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-daf0b50d-181d-4533-8213-8adc83f22565 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:02.241217 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-daf0b50d-181d-4533-8213-8adc83f22565 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:02.241629 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-daf0b50d-181d-4533-8213-8adc83f22565 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:02.442862 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-daf0b50d-181d-4533-8213-8adc83f22565 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208daa6413d34e4496e278fb3fc251a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba803ac5e71467f853215e19a7f8867', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:36:02.451104 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-daf0b50d-181d-4533-8213-8adc83f22565 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] 10.222.0.23 "GET /compute/v2.1/servers/9bed6256-fc6f-40dd-b465-54981581a6aa" status: 200 len: 1260 microversion: 2.1 time: 0.223159 Sep 09 16:36:02.451679 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 286/573] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:36:02 2022] GET /compute/v2.1/servers/9bed6256-fc6f-40dd-b465-54981581a6aa => generated 1260 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:36:03.479452 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-b700dc8e-f75a-4619-9e9c-80d3cee0f1d2 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:36:03.480548 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-b700dc8e-f75a-4619-9e9c-80d3cee0f1d2 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] [instance: 9bed6256-fc6f-40dd-b465-54981581a6aa] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:36:03.491337 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-b700dc8e-f75a-4619-9e9c-80d3cee0f1d2 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:03.492127 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-b700dc8e-f75a-4619-9e9c-80d3cee0f1d2 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:03.492845 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-b700dc8e-f75a-4619-9e9c-80d3cee0f1d2 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:03.493853 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-b700dc8e-f75a-4619-9e9c-80d3cee0f1d2 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:03.494306 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-b700dc8e-f75a-4619-9e9c-80d3cee0f1d2 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:03.494753 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-b700dc8e-f75a-4619-9e9c-80d3cee0f1d2 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:03.632084 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-b700dc8e-f75a-4619-9e9c-80d3cee0f1d2 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208daa6413d34e4496e278fb3fc251a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba803ac5e71467f853215e19a7f8867', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:36:03.640079 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-b700dc8e-f75a-4619-9e9c-80d3cee0f1d2 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] 10.222.0.23 "GET /compute/v2.1/servers/9bed6256-fc6f-40dd-b465-54981581a6aa" status: 200 len: 1260 microversion: 2.1 time: 0.168595 Sep 09 16:36:03.640664 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 288/574] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:36:03 2022] GET /compute/v2.1/servers/9bed6256-fc6f-40dd-b465-54981581a6aa => generated 1260 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:36:04.670135 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-1cf110ef-7abe-403d-bd85-b38cc41ce8e3 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:36:04.671144 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-1cf110ef-7abe-403d-bd85-b38cc41ce8e3 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] [instance: 9bed6256-fc6f-40dd-b465-54981581a6aa] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:36:04.681854 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1cf110ef-7abe-403d-bd85-b38cc41ce8e3 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:04.682759 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1cf110ef-7abe-403d-bd85-b38cc41ce8e3 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:04.683513 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1cf110ef-7abe-403d-bd85-b38cc41ce8e3 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:04.684644 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1cf110ef-7abe-403d-bd85-b38cc41ce8e3 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:04.685399 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1cf110ef-7abe-403d-bd85-b38cc41ce8e3 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:04.686089 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1cf110ef-7abe-403d-bd85-b38cc41ce8e3 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:04.832276 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-1cf110ef-7abe-403d-bd85-b38cc41ce8e3 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208daa6413d34e4496e278fb3fc251a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba803ac5e71467f853215e19a7f8867', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:36:04.840235 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-1cf110ef-7abe-403d-bd85-b38cc41ce8e3 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] 10.222.0.23 "GET /compute/v2.1/servers/9bed6256-fc6f-40dd-b465-54981581a6aa" status: 200 len: 1260 microversion: 2.1 time: 0.177369 Sep 09 16:36:04.840800 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 287/575] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:36:04 2022] GET /compute/v2.1/servers/9bed6256-fc6f-40dd-b465-54981581a6aa => generated 1260 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:36:05.867111 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-3866eafe-2ca0-4fba-9285-33ff12051628 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:36:05.868158 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-3866eafe-2ca0-4fba-9285-33ff12051628 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] [instance: 9bed6256-fc6f-40dd-b465-54981581a6aa] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:36:05.875049 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-3866eafe-2ca0-4fba-9285-33ff12051628 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:05.875538 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-3866eafe-2ca0-4fba-9285-33ff12051628 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:05.875970 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-3866eafe-2ca0-4fba-9285-33ff12051628 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:05.876699 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-3866eafe-2ca0-4fba-9285-33ff12051628 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:05.877150 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-3866eafe-2ca0-4fba-9285-33ff12051628 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:05.877577 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-3866eafe-2ca0-4fba-9285-33ff12051628 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:06.020065 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-3866eafe-2ca0-4fba-9285-33ff12051628 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208daa6413d34e4496e278fb3fc251a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba803ac5e71467f853215e19a7f8867', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:36:06.032010 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-3866eafe-2ca0-4fba-9285-33ff12051628 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] 10.222.0.23 "GET /compute/v2.1/servers/9bed6256-fc6f-40dd-b465-54981581a6aa" status: 200 len: 1260 microversion: 2.1 time: 0.171243 Sep 09 16:36:06.032997 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 289/576] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:36:05 2022] GET /compute/v2.1/servers/9bed6256-fc6f-40dd-b465-54981581a6aa => generated 1260 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:36:07.058468 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-a3ed15c0-b474-4232-a36b-65027268dbc1 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:36:07.059146 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-a3ed15c0-b474-4232-a36b-65027268dbc1 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] [instance: 9bed6256-fc6f-40dd-b465-54981581a6aa] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:36:07.065704 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a3ed15c0-b474-4232-a36b-65027268dbc1 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:07.066187 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a3ed15c0-b474-4232-a36b-65027268dbc1 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:07.066691 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a3ed15c0-b474-4232-a36b-65027268dbc1 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:07.067379 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a3ed15c0-b474-4232-a36b-65027268dbc1 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:07.067818 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a3ed15c0-b474-4232-a36b-65027268dbc1 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:07.068237 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a3ed15c0-b474-4232-a36b-65027268dbc1 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:07.208247 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-a3ed15c0-b474-4232-a36b-65027268dbc1 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208daa6413d34e4496e278fb3fc251a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba803ac5e71467f853215e19a7f8867', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:36:07.216334 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-a3ed15c0-b474-4232-a36b-65027268dbc1 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] 10.222.0.23 "GET /compute/v2.1/servers/9bed6256-fc6f-40dd-b465-54981581a6aa" status: 200 len: 1260 microversion: 2.1 time: 0.163775 Sep 09 16:36:07.216908 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 288/577] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:36:07 2022] GET /compute/v2.1/servers/9bed6256-fc6f-40dd-b465-54981581a6aa => generated 1260 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:36:08.239482 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-3d04daf4-0143-42ba-a564-24352194071c tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:36:08.240041 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-3d04daf4-0143-42ba-a564-24352194071c tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] [instance: 9bed6256-fc6f-40dd-b465-54981581a6aa] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:36:08.242521 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG dbcounter [-] [127196] Writing DB stats nova_cell0:SELECT=2 {{(pid=127196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:36:08.248450 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-3d04daf4-0143-42ba-a564-24352194071c tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:08.248935 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-3d04daf4-0143-42ba-a564-24352194071c tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:08.249355 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-3d04daf4-0143-42ba-a564-24352194071c tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:08.250034 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-3d04daf4-0143-42ba-a564-24352194071c tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:08.250491 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-3d04daf4-0143-42ba-a564-24352194071c tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:08.250914 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-3d04daf4-0143-42ba-a564-24352194071c tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:08.269278 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG dbcounter [-] [127196] Writing DB stats nova_cell1:SELECT=100 {{(pid=127196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:36:08.382145 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-3d04daf4-0143-42ba-a564-24352194071c tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208daa6413d34e4496e278fb3fc251a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba803ac5e71467f853215e19a7f8867', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:36:08.390159 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-3d04daf4-0143-42ba-a564-24352194071c tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] 10.222.0.23 "GET /compute/v2.1/servers/9bed6256-fc6f-40dd-b465-54981581a6aa" status: 200 len: 1260 microversion: 2.1 time: 0.154823 Sep 09 16:36:08.390731 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 290/578] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:36:08 2022] GET /compute/v2.1/servers/9bed6256-fc6f-40dd-b465-54981581a6aa => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:36:09.416723 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-a3985f4d-f68d-48fc-ba8e-880cb865d914 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:36:09.417646 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-a3985f4d-f68d-48fc-ba8e-880cb865d914 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] [instance: 9bed6256-fc6f-40dd-b465-54981581a6aa] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:36:09.421097 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell0:SELECT=2 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:36:09.422162 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell0:SELECT=6 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:36:09.432345 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a3985f4d-f68d-48fc-ba8e-880cb865d914 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:09.433240 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a3985f4d-f68d-48fc-ba8e-880cb865d914 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:09.433684 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a3985f4d-f68d-48fc-ba8e-880cb865d914 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:09.434372 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a3985f4d-f68d-48fc-ba8e-880cb865d914 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:09.434837 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a3985f4d-f68d-48fc-ba8e-880cb865d914 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:09.435251 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a3985f4d-f68d-48fc-ba8e-880cb865d914 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:09.569910 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-a3985f4d-f68d-48fc-ba8e-880cb865d914 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208daa6413d34e4496e278fb3fc251a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba803ac5e71467f853215e19a7f8867', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:36:09.577266 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-a3985f4d-f68d-48fc-ba8e-880cb865d914 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] 10.222.0.23 "GET /compute/v2.1/servers/9bed6256-fc6f-40dd-b465-54981581a6aa" status: 200 len: 1260 microversion: 2.1 time: 0.167312 Sep 09 16:36:09.577801 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 289/579] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:36:09 2022] GET /compute/v2.1/servers/9bed6256-fc6f-40dd-b465-54981581a6aa => generated 1260 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:36:10.599367 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-a556e3b3-9e28-4697-9a25-053752eba22d tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:36:10.599971 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-a556e3b3-9e28-4697-9a25-053752eba22d tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] [instance: 9bed6256-fc6f-40dd-b465-54981581a6aa] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:36:10.606854 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-a556e3b3-9e28-4697-9a25-053752eba22d tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:10.607333 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-a556e3b3-9e28-4697-9a25-053752eba22d tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:10.607757 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-a556e3b3-9e28-4697-9a25-053752eba22d tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:10.608449 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-a556e3b3-9e28-4697-9a25-053752eba22d tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:10.609438 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-a556e3b3-9e28-4697-9a25-053752eba22d tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:10.609438 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-a556e3b3-9e28-4697-9a25-053752eba22d tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:10.747668 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-a556e3b3-9e28-4697-9a25-053752eba22d tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208daa6413d34e4496e278fb3fc251a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba803ac5e71467f853215e19a7f8867', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:36:10.755483 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-a556e3b3-9e28-4697-9a25-053752eba22d tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] 10.222.0.23 "GET /compute/v2.1/servers/9bed6256-fc6f-40dd-b465-54981581a6aa" status: 200 len: 1260 microversion: 2.1 time: 0.160079 Sep 09 16:36:10.756068 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 291/580] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:36:10 2022] GET /compute/v2.1/servers/9bed6256-fc6f-40dd-b465-54981581a6aa => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:36:11.781058 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-1e33d0bb-f248-4d37-b950-756934fca14c tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:36:11.781652 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-1e33d0bb-f248-4d37-b950-756934fca14c tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] [instance: 9bed6256-fc6f-40dd-b465-54981581a6aa] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:36:11.788406 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1e33d0bb-f248-4d37-b950-756934fca14c tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:11.788881 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1e33d0bb-f248-4d37-b950-756934fca14c tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:11.789324 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1e33d0bb-f248-4d37-b950-756934fca14c tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:11.789989 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1e33d0bb-f248-4d37-b950-756934fca14c tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:11.790435 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1e33d0bb-f248-4d37-b950-756934fca14c tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:11.790885 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1e33d0bb-f248-4d37-b950-756934fca14c tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:11.932740 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-1e33d0bb-f248-4d37-b950-756934fca14c tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208daa6413d34e4496e278fb3fc251a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba803ac5e71467f853215e19a7f8867', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:36:11.940592 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-1e33d0bb-f248-4d37-b950-756934fca14c tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] 10.222.0.23 "GET /compute/v2.1/servers/9bed6256-fc6f-40dd-b465-54981581a6aa" status: 200 len: 1260 microversion: 2.1 time: 0.164550 Sep 09 16:36:11.941203 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 290/581] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:36:11 2022] GET /compute/v2.1/servers/9bed6256-fc6f-40dd-b465-54981581a6aa => generated 1260 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:36:12.758617 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [req-29a37b9f-d46b-4b90-8d4b-c8efeee4652e req-d729e2df-3265-4fa5-ad67-c32fc9395dc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bed6256-fc6f-40dd-b465-54981581a6aa", "name": "network-vif-plugged", "status": "completed", "tag": "7151e062-a48c-4cc1-be6e-dbf4d66de6e4"}]} {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:36:12.768878 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [req-29a37b9f-d46b-4b90-8d4b-c8efeee4652e req-d729e2df-3265-4fa5-ad67-c32fc9395dc4 service nova] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:12.769356 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [req-29a37b9f-d46b-4b90-8d4b-c8efeee4652e req-d729e2df-3265-4fa5-ad67-c32fc9395dc4 service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:12.769788 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [req-29a37b9f-d46b-4b90-8d4b-c8efeee4652e req-d729e2df-3265-4fa5-ad67-c32fc9395dc4 service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:12.781136 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.compute.server_external_events [req-29a37b9f-d46b-4b90-8d4b-c8efeee4652e req-d729e2df-3265-4fa5-ad67-c32fc9395dc4 service nova] Creating event network-vif-plugged:7151e062-a48c-4cc1-be6e-dbf4d66de6e4 for instance 9bed6256-fc6f-40dd-b465-54981581a6aa on hv-cinder-83124 Sep 09 16:36:12.786160 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [req-29a37b9f-d46b-4b90-8d4b-c8efeee4652e req-d729e2df-3265-4fa5-ad67-c32fc9395dc4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031412 Sep 09 16:36:12.786842 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 292/582] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Sep 9 16:36:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:36:12.963766 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-285fc98c-cbb7-4a27-ba0a-3bd1032ec4c0 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:36:12.964469 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-285fc98c-cbb7-4a27-ba0a-3bd1032ec4c0 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] [instance: 9bed6256-fc6f-40dd-b465-54981581a6aa] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:36:12.970816 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-285fc98c-cbb7-4a27-ba0a-3bd1032ec4c0 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:12.971302 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-285fc98c-cbb7-4a27-ba0a-3bd1032ec4c0 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:12.971739 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-285fc98c-cbb7-4a27-ba0a-3bd1032ec4c0 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:12.972422 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-285fc98c-cbb7-4a27-ba0a-3bd1032ec4c0 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:12.972873 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-285fc98c-cbb7-4a27-ba0a-3bd1032ec4c0 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:12.973289 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-285fc98c-cbb7-4a27-ba0a-3bd1032ec4c0 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:13.171892 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-285fc98c-cbb7-4a27-ba0a-3bd1032ec4c0 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208daa6413d34e4496e278fb3fc251a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba803ac5e71467f853215e19a7f8867', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:36:13.184013 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-285fc98c-cbb7-4a27-ba0a-3bd1032ec4c0 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] 10.222.0.23 "GET /compute/v2.1/servers/9bed6256-fc6f-40dd-b465-54981581a6aa" status: 200 len: 1260 microversion: 2.1 time: 0.223866 Sep 09 16:36:13.184825 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 291/583] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:36:12 2022] GET /compute/v2.1/servers/9bed6256-fc6f-40dd-b465-54981581a6aa => generated 1260 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:36:14.208527 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-40e95e3e-5525-4293-94ab-633a73318545 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:36:14.209220 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-40e95e3e-5525-4293-94ab-633a73318545 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] [instance: 9bed6256-fc6f-40dd-b465-54981581a6aa] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:36:14.216464 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-40e95e3e-5525-4293-94ab-633a73318545 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:14.216948 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-40e95e3e-5525-4293-94ab-633a73318545 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:14.217375 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-40e95e3e-5525-4293-94ab-633a73318545 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:14.218064 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-40e95e3e-5525-4293-94ab-633a73318545 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:14.218525 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-40e95e3e-5525-4293-94ab-633a73318545 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:14.218970 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-40e95e3e-5525-4293-94ab-633a73318545 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:14.362872 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-40e95e3e-5525-4293-94ab-633a73318545 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208daa6413d34e4496e278fb3fc251a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba803ac5e71467f853215e19a7f8867', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:36:14.371679 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-40e95e3e-5525-4293-94ab-633a73318545 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] 10.222.0.23 "GET /compute/v2.1/servers/9bed6256-fc6f-40dd-b465-54981581a6aa" status: 200 len: 1260 microversion: 2.1 time: 0.167991 Sep 09 16:36:14.372477 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 293/584] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:36:14 2022] GET /compute/v2.1/servers/9bed6256-fc6f-40dd-b465-54981581a6aa => generated 1260 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:36:15.398484 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-2ef03e46-cefa-446f-8e74-e21bdcb9b9e4 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:36:15.399492 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-2ef03e46-cefa-446f-8e74-e21bdcb9b9e4 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] [instance: 9bed6256-fc6f-40dd-b465-54981581a6aa] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:36:15.403265 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=3 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:36:15.409741 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2ef03e46-cefa-446f-8e74-e21bdcb9b9e4 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:15.410337 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2ef03e46-cefa-446f-8e74-e21bdcb9b9e4 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:15.410969 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2ef03e46-cefa-446f-8e74-e21bdcb9b9e4 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:15.411656 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2ef03e46-cefa-446f-8e74-e21bdcb9b9e4 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:15.412100 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2ef03e46-cefa-446f-8e74-e21bdcb9b9e4 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:15.412496 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2ef03e46-cefa-446f-8e74-e21bdcb9b9e4 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:15.547390 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-2ef03e46-cefa-446f-8e74-e21bdcb9b9e4 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208daa6413d34e4496e278fb3fc251a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba803ac5e71467f853215e19a7f8867', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:36:15.555688 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-2ef03e46-cefa-446f-8e74-e21bdcb9b9e4 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] 10.222.0.23 "GET /compute/v2.1/servers/9bed6256-fc6f-40dd-b465-54981581a6aa" status: 200 len: 1443 microversion: 2.1 time: 0.163743 Sep 09 16:36:15.556257 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 292/585] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:36:15 2022] GET /compute/v2.1/servers/9bed6256-fc6f-40dd-b465-54981581a6aa => generated 1443 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:36:15.579290 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-b346c84d-2cd7-48ee-883c-665c1f3bb4cb tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:36:15.579891 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-b346c84d-2cd7-48ee-883c-665c1f3bb4cb tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] [instance: 9bed6256-fc6f-40dd-b465-54981581a6aa] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:36:15.582279 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG dbcounter [-] [127196] Writing DB stats nova_api:SELECT=57 {{(pid=127196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:36:15.588110 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-b346c84d-2cd7-48ee-883c-665c1f3bb4cb tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:15.588589 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-b346c84d-2cd7-48ee-883c-665c1f3bb4cb tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:15.589020 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-b346c84d-2cd7-48ee-883c-665c1f3bb4cb tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:15.589705 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-b346c84d-2cd7-48ee-883c-665c1f3bb4cb tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:15.590184 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-b346c84d-2cd7-48ee-883c-665c1f3bb4cb tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:15.590667 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-b346c84d-2cd7-48ee-883c-665c1f3bb4cb tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:15.729498 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-b346c84d-2cd7-48ee-883c-665c1f3bb4cb tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208daa6413d34e4496e278fb3fc251a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba803ac5e71467f853215e19a7f8867', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:36:15.737714 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-b346c84d-2cd7-48ee-883c-665c1f3bb4cb tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] 10.222.0.23 "GET /compute/v2.1/servers/9bed6256-fc6f-40dd-b465-54981581a6aa" status: 200 len: 1443 microversion: 2.1 time: 0.162593 Sep 09 16:36:15.738291 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 294/586] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:36:15 2022] GET /compute/v2.1/servers/9bed6256-fc6f-40dd-b465-54981581a6aa => generated 1443 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:36:17.404096 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [req-5eba4ada-d76b-485a-9729-d25d72e942ae req-179bfc5f-3dc9-491e-bdc1-3222f779bcdb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9bed6256-fc6f-40dd-b465-54981581a6aa", "tag": "7151e062-a48c-4cc1-be6e-dbf4d66de6e4"}]} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:36:17.413845 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-5eba4ada-d76b-485a-9729-d25d72e942ae req-179bfc5f-3dc9-491e-bdc1-3222f779bcdb service nova] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:17.414333 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-5eba4ada-d76b-485a-9729-d25d72e942ae req-179bfc5f-3dc9-491e-bdc1-3222f779bcdb service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:17.414798 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-5eba4ada-d76b-485a-9729-d25d72e942ae req-179bfc5f-3dc9-491e-bdc1-3222f779bcdb service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:17.426242 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.compute.server_external_events [req-5eba4ada-d76b-485a-9729-d25d72e942ae req-179bfc5f-3dc9-491e-bdc1-3222f779bcdb service nova] Creating event network-changed:7151e062-a48c-4cc1-be6e-dbf4d66de6e4 for instance 9bed6256-fc6f-40dd-b465-54981581a6aa on hv-cinder-83124 Sep 09 16:36:17.431365 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [req-5eba4ada-d76b-485a-9729-d25d72e942ae req-179bfc5f-3dc9-491e-bdc1-3222f779bcdb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031014 Sep 09 16:36:17.431986 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 293/587] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Sep 9 16:36:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:36:20.539631 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-659d142c-8108-4f16-84f8-5f2405ee1035 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:36:20.541844 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-659d142c-8108-4f16-84f8-5f2405ee1035 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] [instance: 9e761961-9c74-444c-bb4b-0b2f82a9d698] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:36:20.549006 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-659d142c-8108-4f16-84f8-5f2405ee1035 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:20.549485 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-659d142c-8108-4f16-84f8-5f2405ee1035 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:20.549913 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-659d142c-8108-4f16-84f8-5f2405ee1035 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:20.550629 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-659d142c-8108-4f16-84f8-5f2405ee1035 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:20.551080 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-659d142c-8108-4f16-84f8-5f2405ee1035 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:20.551513 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-659d142c-8108-4f16-84f8-5f2405ee1035 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:20.582525 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-659d142c-8108-4f16-84f8-5f2405ee1035 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] 10.222.0.23 "GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046904 Sep 09 16:36:20.583090 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 295/588] 10.222.0.23 () {58 vars in 1302 bytes} [Fri Sep 9 16:36:20 2022] GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 09 16:36:20.651306 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-d6ac4bc9-43ae-48af-ab7d-48f750b46f2e tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:36:20.651886 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-d6ac4bc9-43ae-48af-ab7d-48f750b46f2e tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] [instance: 9e761961-9c74-444c-bb4b-0b2f82a9d698] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:36:20.658451 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d6ac4bc9-43ae-48af-ab7d-48f750b46f2e tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:20.658942 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d6ac4bc9-43ae-48af-ab7d-48f750b46f2e tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:20.659400 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d6ac4bc9-43ae-48af-ab7d-48f750b46f2e tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:20.660095 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d6ac4bc9-43ae-48af-ab7d-48f750b46f2e tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:20.660549 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d6ac4bc9-43ae-48af-ab7d-48f750b46f2e tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:20.660969 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d6ac4bc9-43ae-48af-ab7d-48f750b46f2e tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:20.686168 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-d6ac4bc9-43ae-48af-ab7d-48f750b46f2e tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] [instance: 9e761961-9c74-444c-bb4b-0b2f82a9d698] Going to try to terminate instance {{(pid=127198) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 16:36:20.767934 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-d6ac4bc9-43ae-48af-ab7d-48f750b46f2e tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] 10.222.0.23 "DELETE /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698" status: 204 len: 0 microversion: 2.1 time: 0.121263 Sep 09 16:36:20.768449 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 294/589] 10.222.0.23 () {58 vars in 1239 bytes} [Fri Sep 9 16:36:20 2022] DELETE /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 16:36:20.776826 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-136fb298-309b-4b67-acb5-c345cb31bd7a tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:36:20.777433 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-136fb298-309b-4b67-acb5-c345cb31bd7a tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] [instance: 9e761961-9c74-444c-bb4b-0b2f82a9d698] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:36:20.783448 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-136fb298-309b-4b67-acb5-c345cb31bd7a tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:20.783925 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-136fb298-309b-4b67-acb5-c345cb31bd7a tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:20.784354 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-136fb298-309b-4b67-acb5-c345cb31bd7a tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:20.785040 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-136fb298-309b-4b67-acb5-c345cb31bd7a tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:20.785490 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-136fb298-309b-4b67-acb5-c345cb31bd7a tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:20.785910 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-136fb298-309b-4b67-acb5-c345cb31bd7a tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:21.173568 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-136fb298-309b-4b67-acb5-c345cb31bd7a tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd095ed814b9e47e08d6b5a4fd2901c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f2e0c002343d88ae25dc7bfb2fe10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:36:21.182908 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-136fb298-309b-4b67-acb5-c345cb31bd7a tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] 10.222.0.23 "GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698" status: 200 len: 1672 microversion: 2.1 time: 0.409883 Sep 09 16:36:21.183523 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 296/590] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:36:20 2022] GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698 => generated 1672 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:36:22.211394 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-b312e59e-218f-43ca-be67-f0000872d08c tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:36:22.212560 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-b312e59e-218f-43ca-be67-f0000872d08c tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] [instance: 9e761961-9c74-444c-bb4b-0b2f82a9d698] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:36:22.221780 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b312e59e-218f-43ca-be67-f0000872d08c tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:22.222262 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b312e59e-218f-43ca-be67-f0000872d08c tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:22.222802 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b312e59e-218f-43ca-be67-f0000872d08c tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:22.223490 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b312e59e-218f-43ca-be67-f0000872d08c tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:22.223937 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b312e59e-218f-43ca-be67-f0000872d08c tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:22.224353 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b312e59e-218f-43ca-be67-f0000872d08c tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:22.368522 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-b312e59e-218f-43ca-be67-f0000872d08c tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd095ed814b9e47e08d6b5a4fd2901c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f2e0c002343d88ae25dc7bfb2fe10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:36:22.376645 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-b312e59e-218f-43ca-be67-f0000872d08c tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] 10.222.0.23 "GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698" status: 200 len: 1672 microversion: 2.1 time: 0.172391 Sep 09 16:36:22.377264 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 295/591] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:36:22 2022] GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698 => generated 1672 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:36:23.400419 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-fcec09ee-143f-4b86-b0aa-e9cfe8410000 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:36:23.400990 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-fcec09ee-143f-4b86-b0aa-e9cfe8410000 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] [instance: 9e761961-9c74-444c-bb4b-0b2f82a9d698] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:36:23.407445 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-fcec09ee-143f-4b86-b0aa-e9cfe8410000 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:23.407920 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-fcec09ee-143f-4b86-b0aa-e9cfe8410000 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:23.408344 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-fcec09ee-143f-4b86-b0aa-e9cfe8410000 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:23.409044 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-fcec09ee-143f-4b86-b0aa-e9cfe8410000 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:23.409480 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-fcec09ee-143f-4b86-b0aa-e9cfe8410000 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:23.409902 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-fcec09ee-143f-4b86-b0aa-e9cfe8410000 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:23.691599 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-fcec09ee-143f-4b86-b0aa-e9cfe8410000 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd095ed814b9e47e08d6b5a4fd2901c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f2e0c002343d88ae25dc7bfb2fe10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:36:23.699844 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-fcec09ee-143f-4b86-b0aa-e9cfe8410000 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] 10.222.0.23 "GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698" status: 200 len: 1672 microversion: 2.1 time: 0.303365 Sep 09 16:36:23.700463 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 297/592] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:36:23 2022] GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698 => generated 1672 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:36:24.283961 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [req-844e3cc4-6220-4293-8f21-afda47e7d797 req-471be6ec-40d9-4bac-9502-346c8d0173e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e761961-9c74-444c-bb4b-0b2f82a9d698", "name": "network-vif-deleted", "tag": "a26fe3a3-c8fd-45e4-8105-8c34395addd8"}]} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:36:24.294558 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-844e3cc4-6220-4293-8f21-afda47e7d797 req-471be6ec-40d9-4bac-9502-346c8d0173e6 service nova] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:24.295350 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-844e3cc4-6220-4293-8f21-afda47e7d797 req-471be6ec-40d9-4bac-9502-346c8d0173e6 service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:24.295973 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-844e3cc4-6220-4293-8f21-afda47e7d797 req-471be6ec-40d9-4bac-9502-346c8d0173e6 service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:24.309604 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.compute.server_external_events [req-844e3cc4-6220-4293-8f21-afda47e7d797 req-471be6ec-40d9-4bac-9502-346c8d0173e6 service nova] Creating event network-vif-deleted:a26fe3a3-c8fd-45e4-8105-8c34395addd8 for instance 9e761961-9c74-444c-bb4b-0b2f82a9d698 on hv-cinder-83124 Sep 09 16:36:24.315705 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [req-844e3cc4-6220-4293-8f21-afda47e7d797 req-471be6ec-40d9-4bac-9502-346c8d0173e6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035448 Sep 09 16:36:24.317205 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 296/593] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Sep 9 16:36:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:36:24.722834 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-4d720479-b93f-4ab3-89c6-f1721c18a9cb tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:36:24.723622 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-4d720479-b93f-4ab3-89c6-f1721c18a9cb tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] [instance: 9e761961-9c74-444c-bb4b-0b2f82a9d698] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:36:24.729961 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-4d720479-b93f-4ab3-89c6-f1721c18a9cb tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:24.731209 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-4d720479-b93f-4ab3-89c6-f1721c18a9cb tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:24.731724 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-4d720479-b93f-4ab3-89c6-f1721c18a9cb tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:24.732491 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-4d720479-b93f-4ab3-89c6-f1721c18a9cb tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:24.733017 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-4d720479-b93f-4ab3-89c6-f1721c18a9cb tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:24.733503 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-4d720479-b93f-4ab3-89c6-f1721c18a9cb tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:24.765275 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-4d720479-b93f-4ab3-89c6-f1721c18a9cb tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:24.765784 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-4d720479-b93f-4ab3-89c6-f1721c18a9cb tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:24.766210 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-4d720479-b93f-4ab3-89c6-f1721c18a9cb tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:24.766659 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.objects.instance [None req-4d720479-b93f-4ab3-89c6-f1721c18a9cb tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lazy-loading 'fault' on Instance uuid 9e761961-9c74-444c-bb4b-0b2f82a9d698 {{(pid=127196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 16:36:24.808443 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-4d720479-b93f-4ab3-89c6-f1721c18a9cb tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd095ed814b9e47e08d6b5a4fd2901c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f2e0c002343d88ae25dc7bfb2fe10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:36:24.816533 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-4d720479-b93f-4ab3-89c6-f1721c18a9cb tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] 10.222.0.23 "GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698" status: 200 len: 1327 microversion: 2.1 time: 0.098155 Sep 09 16:36:24.817337 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 298/594] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:36:24 2022] GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698 => generated 1327 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:36:25.844673 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-73a95829-3027-4e61-b094-a389466aefec tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:36:25.845575 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-73a95829-3027-4e61-b094-a389466aefec tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] [instance: 9e761961-9c74-444c-bb4b-0b2f82a9d698] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:36:25.854526 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-73a95829-3027-4e61-b094-a389466aefec tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:25.855167 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-73a95829-3027-4e61-b094-a389466aefec tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:25.855737 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-73a95829-3027-4e61-b094-a389466aefec tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:25.856639 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-73a95829-3027-4e61-b094-a389466aefec tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:25.857239 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-73a95829-3027-4e61-b094-a389466aefec tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:25.857791 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-73a95829-3027-4e61-b094-a389466aefec tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:25.863117 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:36:25.876653 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.wsgi [None req-73a95829-3027-4e61-b094-a389466aefec tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] HTTP exception thrown: Instance 9e761961-9c74-444c-bb4b-0b2f82a9d698 could not be found. Sep 09 16:36:25.878471 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-73a95829-3027-4e61-b094-a389466aefec tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Request method failure captured: Sep 09 16:36:25.878471 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: request: GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698 HTTP/1.1 Sep 09 16:36:25.878471 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Accept: application/json Sep 09 16:36:25.878471 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Accept-Encoding: identity Sep 09 16:36:25.878471 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Connection: close Sep 09 16:36:25.878471 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Content-Length: 0 Sep 09 16:36:25.878471 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Content-Type: application/json Sep 09 16:36:25.878471 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Host: 10.222.0.23 Sep 09 16:36:25.878471 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Openstack-System-Scope: None Sep 09 16:36:25.878471 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: User-Agent: python-urllib3/1.26.12 Sep 09 16:36:25.878471 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Auth-Token: gAAAAABjG2p5h27SNGzaEpji7SWrLO5cgdqsF7efiLI2ph1vni7NHoRtUz6NkAUldAhjPwUaWVflxxS46FZgyOUf_zmOAGi-dTPqh7WbuBAnycxGx0udk1PEjoMJv7YQhQ0d8oPz8gs7S9PKaOIRpoyjcGeIgaCRey4yIJ-sI0C9gxuQnuVKgbw Sep 09 16:36:25.878471 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Domain-Id: None Sep 09 16:36:25.878471 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Domain-Name: None Sep 09 16:36:25.878471 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Identity-Status: Confirmed Sep 09 16:36:25.878471 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Is-Admin-Project: True Sep 09 16:36:25.878471 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Project-Domain-Id: default Sep 09 16:36:25.878471 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Project-Domain-Name: Default Sep 09 16:36:25.878471 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Project-Id: f90f2e0c002343d88ae25dc7bfb2fe10 Sep 09 16:36:25.878471 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Project-Name: tempest-AttachVolumeTestJSON-1369004595 Sep 09 16:36:25.878471 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Role: member,reader Sep 09 16:36:25.878471 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Roles: member,reader Sep 09 16:36:25.880071 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f90f2e0c002343d88ae25dc7bfb2fe10"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f90f2e0c002343d88ae25dc7bfb2fe10"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f90f2e0c002343d88ae25dc7bfb2fe10"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f90f2e0c002343d88ae25dc7bfb2fe10"}]}] Sep 09 16:36:25.880071 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Tenant: tempest-AttachVolumeTestJSON-1369004595 Sep 09 16:36:25.880071 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Tenant-Id: f90f2e0c002343d88ae25dc7bfb2fe10 Sep 09 16:36:25.880071 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1369004595 Sep 09 16:36:25.880071 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User: tempest-AttachVolumeTestJSON-1369004595-project Sep 09 16:36:25.880071 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User-Domain-Id: default Sep 09 16:36:25.880071 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User-Domain-Name: Default Sep 09 16:36:25.880071 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User-Id: d095ed814b9e47e08d6b5a4fd2901c43 Sep 09 16:36:25.880071 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User-Name: tempest-AttachVolumeTestJSON-1369004595-project Sep 09 16:36:25.880071 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: method: > Sep 09 16:36:25.880071 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: exception: Instance 9e761961-9c74-444c-bb4b-0b2f82a9d698 could not be found. Sep 09 16:36:25.880071 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: action_args: {'id': '9e761961-9c74-444c-bb4b-0b2f82a9d698'} Sep 09 16:36:25.880977 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 16:36:25.880977 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:36:25.880977 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 16:36:25.880977 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 16:36:25.880977 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 16:36:25.880977 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 16:36:25.880977 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 16:36:25.880977 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 16:36:25.880977 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 16:36:25.880977 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 16:36:25.880977 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e761961-9c74-444c-bb4b-0b2f82a9d698 could not be found. Sep 09 16:36:25.880977 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:36:25.880977 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 16:36:25.880977 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:36:25.880977 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:36:25.880977 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 16:36:25.880977 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 16:36:25.880977 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 16:36:25.880977 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 16:36:25.880977 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 16:36:25.882402 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 16:36:25.882402 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 16:36:25.882402 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 16:36:25.882402 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 16:36:25.882402 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 16:36:25.882402 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 16:36:25.882402 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 16:36:25.882402 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e761961-9c74-444c-bb4b-0b2f82a9d698 could not be found. Sep 09 16:36:25.882402 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:36:25.882402 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 16:36:25.882402 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:36:25.882402 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:36:25.882402 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 16:36:25.882402 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 16:36:25.882402 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 16:36:25.882402 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 16:36:25.882402 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e761961-9c74-444c-bb4b-0b2f82a9d698 could not be found. Sep 09 16:36:25.882402 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:36:25.883838 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-73a95829-3027-4e61-b094-a389466aefec tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Returning 404 to user: Instance 9e761961-9c74-444c-bb4b-0b2f82a9d698 could not be found. {{(pid=127198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 16:36:25.883838 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-73a95829-3027-4e61-b094-a389466aefec tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] 10.222.0.23 "GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698" status: 404 len: 111 microversion: 2.1 time: 0.042347 Sep 09 16:36:25.883838 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 297/595] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:36:25 2022] GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 16:36:25.889155 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-30b4a5db-63e7-48a4-8718-6dc1665959f8 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Calling method '.version_select at 0x7f24fb600b80>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:36:25.910040 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-30b4a5db-63e7-48a4-8718-6dc1665959f8 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-607968590" status: 202 len: 0 microversion: 2.1 time: 0.024723 Sep 09 16:36:25.910664 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 299/596] 10.222.0.23 () {58 vars in 1218 bytes} [Fri Sep 9 16:36:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-607968590 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 16:36:26.560442 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-b13b1e5e-4672-47b1-b677-23ed7e196b34 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Action: 'create', calling method: .version_select at 0x7f24fb509040>, body: {"keypair": {"name": "tempest-keypair-360955613", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPEzPm/cR991zqhc4/rgqD9PNfVxsPaKFEnsADnMlnLx4IFNHHV9MP8jruveRzLSE1jKNhOOvN4Hh3ybd2Mijj078G6JpftYLgYLYccS3fBLBsNzpuEFU0Js15eqRhnGBg=="}} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:36:26.577463 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.quota [None req-b13b1e5e-4672-47b1-b677-23ed7e196b34 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Getting quotas for project f90f2e0c002343d88ae25dc7bfb2fe10. Resources: {'key_pairs'} {{(pid=127198) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 16:36:26.581501 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.quota [None req-b13b1e5e-4672-47b1-b677-23ed7e196b34 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Getting quotas for user d095ed814b9e47e08d6b5a4fd2901c43 and project f90f2e0c002343d88ae25dc7bfb2fe10. Resources: {'key_pairs'} {{(pid=127198) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 16:36:26.605014 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-b13b1e5e-4672-47b1-b677-23ed7e196b34 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.048424 Sep 09 16:36:26.605598 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 298/597] 10.222.0.23 () {60 vars in 1159 bytes} [Fri Sep 9 16:36:26 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:36:28.165265 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-568eeee0-342e-49e3-ac4c-22571af54f40 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1566924492", "imageRef": "0b1ba34f-2223-497a-9a18-c2ad8d398aae", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "80eeb587-e34e-4396-bf26-1f500780ff13"}], "security_groups": [{"name": "tempest-securitygroup--420101252"}], "key_name": "tempest-keypair-360955613", "user_data": "}} {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:36:28.271346 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.network.neutron [None req-568eeee0-342e-49e3-ac4c-22571af54f40 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] validate_networks() for [('80eeb587-e34e-4396-bf26-1f500780ff13', None, None, None, None, None)] {{(pid=127196) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 16:36:28.645202 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.virt.hardware [None req-568eeee0-342e-49e3-ac4c-22571af54f40 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Flavor limits 0:0:0 {{(pid=127196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 16:36:28.645845 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.virt.hardware [None req-568eeee0-342e-49e3-ac4c-22571af54f40 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Image limits 0:0:0 {{(pid=127196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 16:36:28.646565 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.virt.hardware [None req-568eeee0-342e-49e3-ac4c-22571af54f40 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Flavor pref 0:0:0 {{(pid=127196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 16:36:28.647108 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.virt.hardware [None req-568eeee0-342e-49e3-ac4c-22571af54f40 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Image pref 0:0:0 {{(pid=127196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 16:36:28.647708 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.virt.hardware [None req-568eeee0-342e-49e3-ac4c-22571af54f40 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 16:36:28.661492 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-568eeee0-342e-49e3-ac4c-22571af54f40 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:28.661979 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-568eeee0-342e-49e3-ac4c-22571af54f40 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:28.662407 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-568eeee0-342e-49e3-ac4c-22571af54f40 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:28.663136 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-568eeee0-342e-49e3-ac4c-22571af54f40 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:28.663572 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-568eeee0-342e-49e3-ac4c-22571af54f40 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:28.663988 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-568eeee0-342e-49e3-ac4c-22571af54f40 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:28.681686 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.quota [None req-568eeee0-342e-49e3-ac4c-22571af54f40 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Getting quotas for project f90f2e0c002343d88ae25dc7bfb2fe10. Resources: {'cores', 'instances', 'ram'} {{(pid=127196) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 16:36:28.685678 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.quota [None req-568eeee0-342e-49e3-ac4c-22571af54f40 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Getting quotas for user d095ed814b9e47e08d6b5a4fd2901c43 and project f90f2e0c002343d88ae25dc7bfb2fe10. Resources: {'cores', 'instances', 'ram'} {{(pid=127196) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 16:36:28.697359 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-568eeee0-342e-49e3-ac4c-22571af54f40 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Going to run 1 instances... {{(pid=127196) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 16:36:28.699695 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-568eeee0-342e-49e3-ac4c-22571af54f40 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] [instance: 8ff53b0d-4020-4a1c-8af5-9cd0fbba8e06] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0b1ba34f-2223-497a-9a18-c2ad8d398aae',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127196) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 16:36:28.748644 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-568eeee0-342e-49e3-ac4c-22571af54f40 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.588207 Sep 09 16:36:28.749297 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 300/598] 10.222.0.23 () {60 vars in 1147 bytes} [Fri Sep 9 16:36:28 2022] POST /compute/v2.1/servers => generated 401 bytes in 590 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 16:36:28.761271 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-8f9fde60-58cf-4b23-8d9d-e6769a7811cf tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:36:28.761850 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-8f9fde60-58cf-4b23-8d9d-e6769a7811cf tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] [instance: 8ff53b0d-4020-4a1c-8af5-9cd0fbba8e06] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:36:28.816898 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-8f9fde60-58cf-4b23-8d9d-e6769a7811cf tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd095ed814b9e47e08d6b5a4fd2901c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f2e0c002343d88ae25dc7bfb2fe10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:36:28.823836 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-8f9fde60-58cf-4b23-8d9d-e6769a7811cf tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] 10.222.0.23 "GET /compute/v2.1/servers/8ff53b0d-4020-4a1c-8af5-9cd0fbba8e06" status: 200 len: 1237 microversion: 2.1 time: 0.066980 Sep 09 16:36:28.824368 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 299/599] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:36:28 2022] GET /compute/v2.1/servers/8ff53b0d-4020-4a1c-8af5-9cd0fbba8e06 => generated 1237 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:36:29.851310 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-b9acb60a-f478-4982-84e4-19dedb80f4ba tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:36:29.852341 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-b9acb60a-f478-4982-84e4-19dedb80f4ba tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] [instance: 8ff53b0d-4020-4a1c-8af5-9cd0fbba8e06] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:36:29.862275 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-b9acb60a-f478-4982-84e4-19dedb80f4ba tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:29.862803 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-b9acb60a-f478-4982-84e4-19dedb80f4ba tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:29.863238 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-b9acb60a-f478-4982-84e4-19dedb80f4ba tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:29.863931 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-b9acb60a-f478-4982-84e4-19dedb80f4ba tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:29.864387 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-b9acb60a-f478-4982-84e4-19dedb80f4ba tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:29.864813 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-b9acb60a-f478-4982-84e4-19dedb80f4ba tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:29.931689 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-b9acb60a-f478-4982-84e4-19dedb80f4ba tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd095ed814b9e47e08d6b5a4fd2901c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f2e0c002343d88ae25dc7bfb2fe10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:36:29.939862 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-b9acb60a-f478-4982-84e4-19dedb80f4ba tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] 10.222.0.23 "GET /compute/v2.1/servers/8ff53b0d-4020-4a1c-8af5-9cd0fbba8e06" status: 200 len: 1289 microversion: 2.1 time: 0.096016 Sep 09 16:36:29.940443 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 301/600] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:36:29 2022] GET /compute/v2.1/servers/8ff53b0d-4020-4a1c-8af5-9cd0fbba8e06 => generated 1289 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:36:30.963830 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-015ebcc1-91f4-4892-9851-3a88121ca098 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:36:30.964516 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-015ebcc1-91f4-4892-9851-3a88121ca098 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] [instance: 8ff53b0d-4020-4a1c-8af5-9cd0fbba8e06] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:36:30.972371 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-015ebcc1-91f4-4892-9851-3a88121ca098 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:30.972789 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-015ebcc1-91f4-4892-9851-3a88121ca098 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:30.973217 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-015ebcc1-91f4-4892-9851-3a88121ca098 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:30.973904 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-015ebcc1-91f4-4892-9851-3a88121ca098 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:30.974347 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-015ebcc1-91f4-4892-9851-3a88121ca098 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:30.974784 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-015ebcc1-91f4-4892-9851-3a88121ca098 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:31.172696 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-015ebcc1-91f4-4892-9851-3a88121ca098 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd095ed814b9e47e08d6b5a4fd2901c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f2e0c002343d88ae25dc7bfb2fe10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:36:31.181278 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-015ebcc1-91f4-4892-9851-3a88121ca098 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] 10.222.0.23 "GET /compute/v2.1/servers/8ff53b0d-4020-4a1c-8af5-9cd0fbba8e06" status: 200 len: 1362 microversion: 2.1 time: 0.221952 Sep 09 16:36:31.182009 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 300/601] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:36:30 2022] GET /compute/v2.1/servers/8ff53b0d-4020-4a1c-8af5-9cd0fbba8e06 => generated 1362 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:36:31.503159 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [req-607e4cad-2706-4e9e-9b55-276025049cea req-04a9010a-0719-4cd7-8831-7bcbf74c7088 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ff53b0d-4020-4a1c-8af5-9cd0fbba8e06", "tag": "0beecb60-e8cf-4260-946b-89ce2b20f0a3"}]} {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:36:31.513590 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [req-607e4cad-2706-4e9e-9b55-276025049cea req-04a9010a-0719-4cd7-8831-7bcbf74c7088 service nova] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:31.514069 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [req-607e4cad-2706-4e9e-9b55-276025049cea req-04a9010a-0719-4cd7-8831-7bcbf74c7088 service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:31.514520 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [req-607e4cad-2706-4e9e-9b55-276025049cea req-04a9010a-0719-4cd7-8831-7bcbf74c7088 service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:31.526017 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.compute.server_external_events [req-607e4cad-2706-4e9e-9b55-276025049cea req-04a9010a-0719-4cd7-8831-7bcbf74c7088 service nova] Creating event network-changed:0beecb60-e8cf-4260-946b-89ce2b20f0a3 for instance 8ff53b0d-4020-4a1c-8af5-9cd0fbba8e06 on hv-cinder-83124 Sep 09 16:36:31.531874 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [req-607e4cad-2706-4e9e-9b55-276025049cea req-04a9010a-0719-4cd7-8831-7bcbf74c7088 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032485 Sep 09 16:36:31.533915 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 302/602] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Sep 9 16:36:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:36:32.207414 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-683b2856-ca70-4d80-a2c1-7f10d631862d tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:36:32.207966 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-683b2856-ca70-4d80-a2c1-7f10d631862d tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] [instance: 8ff53b0d-4020-4a1c-8af5-9cd0fbba8e06] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:36:32.215182 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-683b2856-ca70-4d80-a2c1-7f10d631862d tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:32.215687 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-683b2856-ca70-4d80-a2c1-7f10d631862d tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:32.216143 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-683b2856-ca70-4d80-a2c1-7f10d631862d tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:32.216869 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-683b2856-ca70-4d80-a2c1-7f10d631862d tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:32.217343 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-683b2856-ca70-4d80-a2c1-7f10d631862d tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:32.217789 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-683b2856-ca70-4d80-a2c1-7f10d631862d tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:32.355921 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-683b2856-ca70-4d80-a2c1-7f10d631862d tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd095ed814b9e47e08d6b5a4fd2901c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f2e0c002343d88ae25dc7bfb2fe10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:36:32.367728 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-683b2856-ca70-4d80-a2c1-7f10d631862d tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] 10.222.0.23 "GET /compute/v2.1/servers/8ff53b0d-4020-4a1c-8af5-9cd0fbba8e06" status: 200 len: 1362 microversion: 2.1 time: 0.165516 Sep 09 16:36:32.368432 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 301/603] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:36:32 2022] GET /compute/v2.1/servers/8ff53b0d-4020-4a1c-8af5-9cd0fbba8e06 => generated 1362 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:36:33.394345 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-b7fc773a-25ec-45b4-8105-5e77f79a98e8 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:36:33.395073 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-b7fc773a-25ec-45b4-8105-5e77f79a98e8 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] [instance: 8ff53b0d-4020-4a1c-8af5-9cd0fbba8e06] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:36:33.401731 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-b7fc773a-25ec-45b4-8105-5e77f79a98e8 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:33.402210 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-b7fc773a-25ec-45b4-8105-5e77f79a98e8 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:33.402687 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-b7fc773a-25ec-45b4-8105-5e77f79a98e8 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:33.403382 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-b7fc773a-25ec-45b4-8105-5e77f79a98e8 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:33.403831 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-b7fc773a-25ec-45b4-8105-5e77f79a98e8 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:33.404245 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-b7fc773a-25ec-45b4-8105-5e77f79a98e8 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:33.651807 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-b7fc773a-25ec-45b4-8105-5e77f79a98e8 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd095ed814b9e47e08d6b5a4fd2901c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f2e0c002343d88ae25dc7bfb2fe10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:36:33.660483 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-b7fc773a-25ec-45b4-8105-5e77f79a98e8 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] 10.222.0.23 "GET /compute/v2.1/servers/8ff53b0d-4020-4a1c-8af5-9cd0fbba8e06" status: 200 len: 1362 microversion: 2.1 time: 0.270821 Sep 09 16:36:33.661137 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 303/604] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:36:33 2022] GET /compute/v2.1/servers/8ff53b0d-4020-4a1c-8af5-9cd0fbba8e06 => generated 1362 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:36:34.684439 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-23f66fed-b66d-454b-b87d-ecf58b596111 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:36:34.685116 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-23f66fed-b66d-454b-b87d-ecf58b596111 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] [instance: 8ff53b0d-4020-4a1c-8af5-9cd0fbba8e06] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:36:34.692019 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-23f66fed-b66d-454b-b87d-ecf58b596111 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:34.692742 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-23f66fed-b66d-454b-b87d-ecf58b596111 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:34.693169 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-23f66fed-b66d-454b-b87d-ecf58b596111 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:34.693852 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-23f66fed-b66d-454b-b87d-ecf58b596111 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:34.694298 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-23f66fed-b66d-454b-b87d-ecf58b596111 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:34.694747 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-23f66fed-b66d-454b-b87d-ecf58b596111 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:34.829980 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-23f66fed-b66d-454b-b87d-ecf58b596111 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd095ed814b9e47e08d6b5a4fd2901c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f2e0c002343d88ae25dc7bfb2fe10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:36:34.837940 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-23f66fed-b66d-454b-b87d-ecf58b596111 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] 10.222.0.23 "GET /compute/v2.1/servers/8ff53b0d-4020-4a1c-8af5-9cd0fbba8e06" status: 200 len: 1362 microversion: 2.1 time: 0.157663 Sep 09 16:36:34.838745 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 302/605] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:36:34 2022] GET /compute/v2.1/servers/8ff53b0d-4020-4a1c-8af5-9cd0fbba8e06 => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:36:35.864549 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-6ddba504-32c0-4f39-94fa-5d5fc9e2110a tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:36:35.865522 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-6ddba504-32c0-4f39-94fa-5d5fc9e2110a tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] [instance: 8ff53b0d-4020-4a1c-8af5-9cd0fbba8e06] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:36:35.876961 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-6ddba504-32c0-4f39-94fa-5d5fc9e2110a tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:35.877717 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-6ddba504-32c0-4f39-94fa-5d5fc9e2110a tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:35.878432 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-6ddba504-32c0-4f39-94fa-5d5fc9e2110a tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:35.879628 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-6ddba504-32c0-4f39-94fa-5d5fc9e2110a tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:35.880406 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-6ddba504-32c0-4f39-94fa-5d5fc9e2110a tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:35.881110 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-6ddba504-32c0-4f39-94fa-5d5fc9e2110a tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:36.267859 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-6ddba504-32c0-4f39-94fa-5d5fc9e2110a tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd095ed814b9e47e08d6b5a4fd2901c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f2e0c002343d88ae25dc7bfb2fe10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:36:36.275634 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-6ddba504-32c0-4f39-94fa-5d5fc9e2110a tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] 10.222.0.23 "GET /compute/v2.1/servers/8ff53b0d-4020-4a1c-8af5-9cd0fbba8e06" status: 200 len: 1362 microversion: 2.1 time: 0.417650 Sep 09 16:36:36.276196 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 304/606] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:36:35 2022] GET /compute/v2.1/servers/8ff53b0d-4020-4a1c-8af5-9cd0fbba8e06 => generated 1362 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:36:36.838585 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [req-b4aeeec4-5ddb-45bf-b496-2d92e8ed4485 req-4a73f61a-01b7-4585-816a-f9f6726d6994 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ff53b0d-4020-4a1c-8af5-9cd0fbba8e06", "name": "network-vif-plugged", "status": "completed", "tag": "0beecb60-e8cf-4260-946b-89ce2b20f0a3"}]} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:36:36.848809 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-b4aeeec4-5ddb-45bf-b496-2d92e8ed4485 req-4a73f61a-01b7-4585-816a-f9f6726d6994 service nova] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:36.849301 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-b4aeeec4-5ddb-45bf-b496-2d92e8ed4485 req-4a73f61a-01b7-4585-816a-f9f6726d6994 service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:36.849736 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-b4aeeec4-5ddb-45bf-b496-2d92e8ed4485 req-4a73f61a-01b7-4585-816a-f9f6726d6994 service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:36.860913 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.compute.server_external_events [req-b4aeeec4-5ddb-45bf-b496-2d92e8ed4485 req-4a73f61a-01b7-4585-816a-f9f6726d6994 service nova] Creating event network-vif-plugged:0beecb60-e8cf-4260-946b-89ce2b20f0a3 for instance 8ff53b0d-4020-4a1c-8af5-9cd0fbba8e06 on hv-cinder-83124 Sep 09 16:36:36.865912 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [req-b4aeeec4-5ddb-45bf-b496-2d92e8ed4485 req-4a73f61a-01b7-4585-816a-f9f6726d6994 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031077 Sep 09 16:36:36.866682 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 303/607] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Sep 9 16:36:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:36:37.303565 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-30af4b6f-ebaf-47ee-b915-a566604bebf0 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:36:37.304540 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-30af4b6f-ebaf-47ee-b915-a566604bebf0 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] [instance: 8ff53b0d-4020-4a1c-8af5-9cd0fbba8e06] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:36:37.316119 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-30af4b6f-ebaf-47ee-b915-a566604bebf0 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:37.316796 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-30af4b6f-ebaf-47ee-b915-a566604bebf0 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:37.317533 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-30af4b6f-ebaf-47ee-b915-a566604bebf0 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:37.318726 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-30af4b6f-ebaf-47ee-b915-a566604bebf0 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:37.319476 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-30af4b6f-ebaf-47ee-b915-a566604bebf0 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:37.320206 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-30af4b6f-ebaf-47ee-b915-a566604bebf0 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:37.468789 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-30af4b6f-ebaf-47ee-b915-a566604bebf0 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd095ed814b9e47e08d6b5a4fd2901c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f2e0c002343d88ae25dc7bfb2fe10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:36:37.476892 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-30af4b6f-ebaf-47ee-b915-a566604bebf0 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] 10.222.0.23 "GET /compute/v2.1/servers/8ff53b0d-4020-4a1c-8af5-9cd0fbba8e06" status: 200 len: 1362 microversion: 2.1 time: 0.180603 Sep 09 16:36:37.477467 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 305/608] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:36:37 2022] GET /compute/v2.1/servers/8ff53b0d-4020-4a1c-8af5-9cd0fbba8e06 => generated 1362 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:36:38.470767 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-4d4350bc-301b-4f40-a84f-89a71a756d0b tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:36:38.471390 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-4d4350bc-301b-4f40-a84f-89a71a756d0b tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] [instance: 11fefdc7-238f-4580-96f8-d4ba861abeea] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:36:38.477758 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4d4350bc-301b-4f40-a84f-89a71a756d0b tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:38.478232 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4d4350bc-301b-4f40-a84f-89a71a756d0b tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:38.478813 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4d4350bc-301b-4f40-a84f-89a71a756d0b tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:38.479497 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4d4350bc-301b-4f40-a84f-89a71a756d0b tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:38.479941 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4d4350bc-301b-4f40-a84f-89a71a756d0b tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:38.480348 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4d4350bc-301b-4f40-a84f-89a71a756d0b tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:38.502349 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-a2fc0236-83e5-44a3-86e5-7b8e12ffc95e tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:36:38.503021 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-a2fc0236-83e5-44a3-86e5-7b8e12ffc95e tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] [instance: 8ff53b0d-4020-4a1c-8af5-9cd0fbba8e06] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:36:38.507548 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-4d4350bc-301b-4f40-a84f-89a71a756d0b tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] 10.222.0.23 "GET /compute/v2.1/servers/11fefdc7-238f-4580-96f8-d4ba861abeea/ips" status: 200 len: 149 microversion: 2.1 time: 0.044708 Sep 09 16:36:38.508361 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 304/609] 10.222.0.23 () {58 vars in 1248 bytes} [Fri Sep 9 16:36:38 2022] GET /compute/v2.1/servers/11fefdc7-238f-4580-96f8-d4ba861abeea/ips => generated 149 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:36:38.515088 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-a2fc0236-83e5-44a3-86e5-7b8e12ffc95e tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:38.515571 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-a2fc0236-83e5-44a3-86e5-7b8e12ffc95e tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:38.516240 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-a2fc0236-83e5-44a3-86e5-7b8e12ffc95e tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:38.516905 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-a2fc0236-83e5-44a3-86e5-7b8e12ffc95e tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:38.517385 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-a2fc0236-83e5-44a3-86e5-7b8e12ffc95e tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:38.518009 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-a2fc0236-83e5-44a3-86e5-7b8e12ffc95e tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:38.520730 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG dbcounter [-] [127196] Writing DB stats nova_cell1:SELECT=77 {{(pid=127196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:36:38.651594 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-a2fc0236-83e5-44a3-86e5-7b8e12ffc95e tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd095ed814b9e47e08d6b5a4fd2901c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f2e0c002343d88ae25dc7bfb2fe10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:36:38.659844 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-a2fc0236-83e5-44a3-86e5-7b8e12ffc95e tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] 10.222.0.23 "GET /compute/v2.1/servers/8ff53b0d-4020-4a1c-8af5-9cd0fbba8e06" status: 200 len: 1362 microversion: 2.1 time: 0.161443 Sep 09 16:36:38.660435 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 306/610] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:36:38 2022] GET /compute/v2.1/servers/8ff53b0d-4020-4a1c-8af5-9cd0fbba8e06 => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 16:36:39.627942 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-1c5904c9-cd71-4f34-885e-b02dfdcbef82 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:36:39.628532 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-1c5904c9-cd71-4f34-885e-b02dfdcbef82 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: 994c3400-0024-457d-88c7-e59b4053062c] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:36:39.630541 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell0:SELECT=6 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:36:39.636555 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1c5904c9-cd71-4f34-885e-b02dfdcbef82 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:39.637039 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1c5904c9-cd71-4f34-885e-b02dfdcbef82 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:39.637476 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1c5904c9-cd71-4f34-885e-b02dfdcbef82 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:39.638173 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1c5904c9-cd71-4f34-885e-b02dfdcbef82 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:39.638660 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1c5904c9-cd71-4f34-885e-b02dfdcbef82 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:39.639089 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1c5904c9-cd71-4f34-885e-b02dfdcbef82 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:39.685169 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-f2ee473e-d7dc-4a6c-844e-9f34fbd782da tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:36:39.685799 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-f2ee473e-d7dc-4a6c-844e-9f34fbd782da tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] [instance: 8ff53b0d-4020-4a1c-8af5-9cd0fbba8e06] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:36:39.687629 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG dbcounter [-] [127196] Writing DB stats nova_cell0:SELECT=2 {{(pid=127196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:36:39.688282 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG dbcounter [-] [127196] Writing DB stats nova_cell0:SELECT=6 {{(pid=127196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:36:39.694758 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f2ee473e-d7dc-4a6c-844e-9f34fbd782da tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:39.695235 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f2ee473e-d7dc-4a6c-844e-9f34fbd782da tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:39.695657 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f2ee473e-d7dc-4a6c-844e-9f34fbd782da tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:39.696342 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f2ee473e-d7dc-4a6c-844e-9f34fbd782da tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:39.696787 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f2ee473e-d7dc-4a6c-844e-9f34fbd782da tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:39.697202 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f2ee473e-d7dc-4a6c-844e-9f34fbd782da tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:39.722166 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.objects.instance [None req-1c5904c9-cd71-4f34-885e-b02dfdcbef82 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lazy-loading 'services' on Instance uuid 994c3400-0024-457d-88c7-e59b4053062c {{(pid=127198) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 16:36:39.794518 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-1c5904c9-cd71-4f34-885e-b02dfdcbef82 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "DELETE /compute/v2.1/servers/994c3400-0024-457d-88c7-e59b4053062c/os-volume_attachments/e1770aee-0b7f-44de-978d-9ab570bdb3ad" status: 202 len: 0 microversion: 2.1 time: 0.170440 Sep 09 16:36:39.798710 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 305/611] 10.222.0.23 () {58 vars in 1416 bytes} [Fri Sep 9 16:36:39 2022] DELETE /compute/v2.1/servers/994c3400-0024-457d-88c7-e59b4053062c/os-volume_attachments/e1770aee-0b7f-44de-978d-9ab570bdb3ad => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 16:36:39.804799 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-6cd43c94-316e-4d86-945b-65f9d0600919 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:36:39.807945 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-6cd43c94-316e-4d86-945b-65f9d0600919 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: 994c3400-0024-457d-88c7-e59b4053062c] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:36:39.814607 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6cd43c94-316e-4d86-945b-65f9d0600919 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:39.815193 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6cd43c94-316e-4d86-945b-65f9d0600919 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:39.815938 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6cd43c94-316e-4d86-945b-65f9d0600919 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:39.816827 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6cd43c94-316e-4d86-945b-65f9d0600919 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:39.817283 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6cd43c94-316e-4d86-945b-65f9d0600919 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:39.817744 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6cd43c94-316e-4d86-945b-65f9d0600919 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:39.843254 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-f2ee473e-d7dc-4a6c-844e-9f34fbd782da tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd095ed814b9e47e08d6b5a4fd2901c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f2e0c002343d88ae25dc7bfb2fe10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:36:39.852189 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-6cd43c94-316e-4d86-945b-65f9d0600919 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/994c3400-0024-457d-88c7-e59b4053062c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052517 Sep 09 16:36:39.852830 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 306/612] 10.222.0.23 () {58 vars in 1302 bytes} [Fri Sep 9 16:36:39 2022] GET /compute/v2.1/servers/994c3400-0024-457d-88c7-e59b4053062c/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:36:39.860990 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-f2ee473e-d7dc-4a6c-844e-9f34fbd782da tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] 10.222.0.23 "GET /compute/v2.1/servers/8ff53b0d-4020-4a1c-8af5-9cd0fbba8e06" status: 200 len: 1548 microversion: 2.1 time: 0.181151 Sep 09 16:36:39.861600 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 307/613] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:36:39 2022] GET /compute/v2.1/servers/8ff53b0d-4020-4a1c-8af5-9cd0fbba8e06 => generated 1548 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:36:39.875724 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-66184d92-d95c-4846-b83f-68104a0fe733 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "75b25113-e122-4a6c-9189-e13acc7f2d5e"}} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:36:39.878367 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-66184d92-d95c-4846-b83f-68104a0fe733 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] [instance: 11fefdc7-238f-4580-96f8-d4ba861abeea] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:36:39.883632 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-65845bb4-26df-4d59-a25b-b1db43568340 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:36:39.884123 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-65845bb4-26df-4d59-a25b-b1db43568340 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] [instance: 8ff53b0d-4020-4a1c-8af5-9cd0fbba8e06] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:36:39.884976 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-66184d92-d95c-4846-b83f-68104a0fe733 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:39.885531 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-66184d92-d95c-4846-b83f-68104a0fe733 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:39.886198 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-66184d92-d95c-4846-b83f-68104a0fe733 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:39.886999 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-66184d92-d95c-4846-b83f-68104a0fe733 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:39.887518 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-66184d92-d95c-4846-b83f-68104a0fe733 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:39.888017 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-66184d92-d95c-4846-b83f-68104a0fe733 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:39.889850 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-65845bb4-26df-4d59-a25b-b1db43568340 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:39.890329 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-65845bb4-26df-4d59-a25b-b1db43568340 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:39.890990 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-65845bb4-26df-4d59-a25b-b1db43568340 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:39.891677 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-65845bb4-26df-4d59-a25b-b1db43568340 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:39.892361 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-65845bb4-26df-4d59-a25b-b1db43568340 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:39.892783 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-65845bb4-26df-4d59-a25b-b1db43568340 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:39.969702 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-65845bb4-26df-4d59-a25b-b1db43568340 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] 10.222.0.23 "GET /compute/v2.1/servers/8ff53b0d-4020-4a1c-8af5-9cd0fbba8e06/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089731 Sep 09 16:36:39.970354 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 308/614] 10.222.0.23 () {58 vars in 1275 bytes} [Fri Sep 9 16:36:39 2022] GET /compute/v2.1/servers/8ff53b0d-4020-4a1c-8af5-9cd0fbba8e06/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:36:40.541379 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-66184d92-d95c-4846-b83f-68104a0fe733 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] 10.222.0.23 "POST /compute/v2.1/servers/11fefdc7-238f-4580-96f8-d4ba861abeea/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.669448 Sep 09 16:36:40.542352 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 307/615] 10.222.0.23 () {60 vars in 1323 bytes} [Fri Sep 9 16:36:39 2022] POST /compute/v2.1/servers/11fefdc7-238f-4580-96f8-d4ba861abeea/os-volume_attachments => generated 194 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:36:40.865872 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-dcb8c5d9-f4f6-4683-85f1-32cb0f865a10 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:36:40.869231 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-dcb8c5d9-f4f6-4683-85f1-32cb0f865a10 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: 994c3400-0024-457d-88c7-e59b4053062c] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:36:40.879041 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-dcb8c5d9-f4f6-4683-85f1-32cb0f865a10 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:40.879528 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-dcb8c5d9-f4f6-4683-85f1-32cb0f865a10 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:40.879968 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-dcb8c5d9-f4f6-4683-85f1-32cb0f865a10 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:40.880665 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-dcb8c5d9-f4f6-4683-85f1-32cb0f865a10 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:40.881153 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-dcb8c5d9-f4f6-4683-85f1-32cb0f865a10 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:40.881866 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-dcb8c5d9-f4f6-4683-85f1-32cb0f865a10 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:40.919245 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-dcb8c5d9-f4f6-4683-85f1-32cb0f865a10 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/994c3400-0024-457d-88c7-e59b4053062c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.057831 Sep 09 16:36:40.919818 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 309/616] 10.222.0.23 () {58 vars in 1302 bytes} [Fri Sep 9 16:36:40 2022] GET /compute/v2.1/servers/994c3400-0024-457d-88c7-e59b4053062c/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 09 16:36:40.977380 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [req-0c5336f7-48d0-4d27-867f-f6cebed808c3 req-8ae0f2e0-2217-47e2-a6c2-b30a9c19d295 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ff53b0d-4020-4a1c-8af5-9cd0fbba8e06", "tag": "0beecb60-e8cf-4260-946b-89ce2b20f0a3"}]} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:36:40.986936 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-0c5336f7-48d0-4d27-867f-f6cebed808c3 req-8ae0f2e0-2217-47e2-a6c2-b30a9c19d295 service nova] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:40.987417 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-0c5336f7-48d0-4d27-867f-f6cebed808c3 req-8ae0f2e0-2217-47e2-a6c2-b30a9c19d295 service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:40.987877 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-0c5336f7-48d0-4d27-867f-f6cebed808c3 req-8ae0f2e0-2217-47e2-a6c2-b30a9c19d295 service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:41.004058 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-e1fdd297-975b-4861-956c-bedfad9cb56f tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:36:41.004352 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.compute.server_external_events [req-0c5336f7-48d0-4d27-867f-f6cebed808c3 req-8ae0f2e0-2217-47e2-a6c2-b30a9c19d295 service nova] Creating event network-changed:0beecb60-e8cf-4260-946b-89ce2b20f0a3 for instance 8ff53b0d-4020-4a1c-8af5-9cd0fbba8e06 on hv-cinder-83124 Sep 09 16:36:41.004927 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-e1fdd297-975b-4861-956c-bedfad9cb56f tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: 994c3400-0024-457d-88c7-e59b4053062c] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:36:41.009881 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [req-0c5336f7-48d0-4d27-867f-f6cebed808c3 req-8ae0f2e0-2217-47e2-a6c2-b30a9c19d295 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037167 Sep 09 16:36:41.010697 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 308/617] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Sep 9 16:36:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:36:41.011226 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e1fdd297-975b-4861-956c-bedfad9cb56f tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:41.011708 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e1fdd297-975b-4861-956c-bedfad9cb56f tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:41.012210 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e1fdd297-975b-4861-956c-bedfad9cb56f tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:41.012903 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e1fdd297-975b-4861-956c-bedfad9cb56f tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:41.013625 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e1fdd297-975b-4861-956c-bedfad9cb56f tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:41.014043 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e1fdd297-975b-4861-956c-bedfad9cb56f tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:41.041169 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-e1fdd297-975b-4861-956c-bedfad9cb56f tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: 994c3400-0024-457d-88c7-e59b4053062c] Going to try to terminate instance {{(pid=127196) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 16:36:41.135375 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-e1fdd297-975b-4861-956c-bedfad9cb56f tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "DELETE /compute/v2.1/servers/994c3400-0024-457d-88c7-e59b4053062c" status: 204 len: 0 microversion: 2.1 time: 0.134676 Sep 09 16:36:41.136060 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 310/618] 10.222.0.23 () {58 vars in 1239 bytes} [Fri Sep 9 16:36:40 2022] DELETE /compute/v2.1/servers/994c3400-0024-457d-88c7-e59b4053062c => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 09 16:36:41.146073 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-4580bb5e-b12a-466d-8b68-afc9299663cd tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:36:41.147108 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-4580bb5e-b12a-466d-8b68-afc9299663cd tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: 994c3400-0024-457d-88c7-e59b4053062c] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:36:41.155437 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4580bb5e-b12a-466d-8b68-afc9299663cd tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:41.156203 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4580bb5e-b12a-466d-8b68-afc9299663cd tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:41.156639 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4580bb5e-b12a-466d-8b68-afc9299663cd tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:41.157343 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4580bb5e-b12a-466d-8b68-afc9299663cd tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:41.157793 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4580bb5e-b12a-466d-8b68-afc9299663cd tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:41.158260 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4580bb5e-b12a-466d-8b68-afc9299663cd tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:41.355321 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-4580bb5e-b12a-466d-8b68-afc9299663cd tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d86f09c6304121be2021cb5c15e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ab544d0b547919794e3efb49ba0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:36:41.363401 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-4580bb5e-b12a-466d-8b68-afc9299663cd tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/994c3400-0024-457d-88c7-e59b4053062c" status: 200 len: 1688 microversion: 2.1 time: 0.222334 Sep 09 16:36:41.364076 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 309/619] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:36:41 2022] GET /compute/v2.1/servers/994c3400-0024-457d-88c7-e59b4053062c => generated 1688 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 16:36:41.950196 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-c2421833-dab9-4e69-9624-fe384076210d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:36:41.950850 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-c2421833-dab9-4e69-9624-fe384076210d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: 27b503a6-c023-49fb-b11a-37da810939cf] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:36:41.957674 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-c2421833-dab9-4e69-9624-fe384076210d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:41.958171 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-c2421833-dab9-4e69-9624-fe384076210d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:41.958607 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-c2421833-dab9-4e69-9624-fe384076210d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:41.959297 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-c2421833-dab9-4e69-9624-fe384076210d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:41.959743 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-c2421833-dab9-4e69-9624-fe384076210d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:41.960165 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-c2421833-dab9-4e69-9624-fe384076210d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:41.994637 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-c2421833-dab9-4e69-9624-fe384076210d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf/os-volume_attachments/8cea5399-43a2-42ca-a9ee-ab1629cb437b" status: 200 len: 194 microversion: 2.20 time: 0.048742 Sep 09 16:36:41.995244 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 311/620] 10.222.0.23 () {60 vars in 1454 bytes} [Fri Sep 9 16:36:41 2022] GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf/os-volume_attachments/8cea5399-43a2-42ca-a9ee-ab1629cb437b => generated 194 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 16:36:42.064266 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-d81f2cf9-2edd-480a-94c9-52e35b1053ef tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:36:42.064826 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-d81f2cf9-2edd-480a-94c9-52e35b1053ef tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: 27b503a6-c023-49fb-b11a-37da810939cf] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:36:42.071671 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d81f2cf9-2edd-480a-94c9-52e35b1053ef tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:42.072157 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d81f2cf9-2edd-480a-94c9-52e35b1053ef tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:42.072666 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d81f2cf9-2edd-480a-94c9-52e35b1053ef tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:42.073361 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d81f2cf9-2edd-480a-94c9-52e35b1053ef tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:42.073818 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d81f2cf9-2edd-480a-94c9-52e35b1053ef tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:42.074247 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d81f2cf9-2edd-480a-94c9-52e35b1053ef tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:42.156347 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.objects.instance [None req-d81f2cf9-2edd-480a-94c9-52e35b1053ef tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lazy-loading 'services' on Instance uuid 27b503a6-c023-49fb-b11a-37da810939cf {{(pid=127198) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 16:36:42.236944 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-d81f2cf9-2edd-480a-94c9-52e35b1053ef tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "DELETE /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf/os-volume_attachments/8cea5399-43a2-42ca-a9ee-ab1629cb437b" status: 202 len: 0 microversion: 2.20 time: 0.176698 Sep 09 16:36:42.237535 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 310/621] 10.222.0.23 () {60 vars in 1457 bytes} [Fri Sep 9 16:36:42 2022] DELETE /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf/os-volume_attachments/8cea5399-43a2-42ca-a9ee-ab1629cb437b => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 09 16:36:42.248308 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-2b7084ee-11e0-476f-862d-1a088b70d469 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:36:42.251562 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-2b7084ee-11e0-476f-862d-1a088b70d469 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: 27b503a6-c023-49fb-b11a-37da810939cf] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:36:42.257638 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-2b7084ee-11e0-476f-862d-1a088b70d469 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:42.258128 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-2b7084ee-11e0-476f-862d-1a088b70d469 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:42.258572 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-2b7084ee-11e0-476f-862d-1a088b70d469 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:42.259251 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-2b7084ee-11e0-476f-862d-1a088b70d469 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:42.259687 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-2b7084ee-11e0-476f-862d-1a088b70d469 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:42.260222 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-2b7084ee-11e0-476f-862d-1a088b70d469 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:42.289477 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-2b7084ee-11e0-476f-862d-1a088b70d469 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047183 Sep 09 16:36:42.290015 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 312/622] 10.222.0.23 () {60 vars in 1343 bytes} [Fri Sep 9 16:36:42 2022] GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 16:36:42.391664 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-f68b9668-f1cb-4772-91b8-3590e3a20ad6 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:36:42.392823 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-f68b9668-f1cb-4772-91b8-3590e3a20ad6 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: 994c3400-0024-457d-88c7-e59b4053062c] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:36:42.403434 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f68b9668-f1cb-4772-91b8-3590e3a20ad6 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:42.404218 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f68b9668-f1cb-4772-91b8-3590e3a20ad6 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:42.404955 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f68b9668-f1cb-4772-91b8-3590e3a20ad6 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:42.406089 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f68b9668-f1cb-4772-91b8-3590e3a20ad6 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:42.406910 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f68b9668-f1cb-4772-91b8-3590e3a20ad6 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:42.407611 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f68b9668-f1cb-4772-91b8-3590e3a20ad6 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:42.550206 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-f68b9668-f1cb-4772-91b8-3590e3a20ad6 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d86f09c6304121be2021cb5c15e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ab544d0b547919794e3efb49ba0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:36:42.558216 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-f68b9668-f1cb-4772-91b8-3590e3a20ad6 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/994c3400-0024-457d-88c7-e59b4053062c" status: 200 len: 1688 microversion: 2.1 time: 0.173816 Sep 09 16:36:42.558845 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 311/623] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:36:42 2022] GET /compute/v2.1/servers/994c3400-0024-457d-88c7-e59b4053062c => generated 1688 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:36:43.303373 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-db1b18a9-e2d9-40c1-895c-189cc7fe9279 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:36:43.305545 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-db1b18a9-e2d9-40c1-895c-189cc7fe9279 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: 27b503a6-c023-49fb-b11a-37da810939cf] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:36:43.312565 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-db1b18a9-e2d9-40c1-895c-189cc7fe9279 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:43.313041 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-db1b18a9-e2d9-40c1-895c-189cc7fe9279 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:43.313469 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-db1b18a9-e2d9-40c1-895c-189cc7fe9279 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:43.314159 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-db1b18a9-e2d9-40c1-895c-189cc7fe9279 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:43.314637 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-db1b18a9-e2d9-40c1-895c-189cc7fe9279 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:43.315056 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-db1b18a9-e2d9-40c1-895c-189cc7fe9279 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:43.344794 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-db1b18a9-e2d9-40c1-895c-189cc7fe9279 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045437 Sep 09 16:36:43.345349 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 313/624] 10.222.0.23 () {60 vars in 1343 bytes} [Fri Sep 9 16:36:43 2022] GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 16:36:43.596510 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-5e9bfb1a-0d32-4d6f-9f3b-32d261c422e4 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:36:43.597122 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-5e9bfb1a-0d32-4d6f-9f3b-32d261c422e4 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: 994c3400-0024-457d-88c7-e59b4053062c] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:36:43.603781 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5e9bfb1a-0d32-4d6f-9f3b-32d261c422e4 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:43.604294 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5e9bfb1a-0d32-4d6f-9f3b-32d261c422e4 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:43.604728 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5e9bfb1a-0d32-4d6f-9f3b-32d261c422e4 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:43.605412 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5e9bfb1a-0d32-4d6f-9f3b-32d261c422e4 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:43.605868 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5e9bfb1a-0d32-4d6f-9f3b-32d261c422e4 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:43.606287 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5e9bfb1a-0d32-4d6f-9f3b-32d261c422e4 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:43.747212 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-5e9bfb1a-0d32-4d6f-9f3b-32d261c422e4 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d86f09c6304121be2021cb5c15e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ab544d0b547919794e3efb49ba0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:36:43.755199 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-5e9bfb1a-0d32-4d6f-9f3b-32d261c422e4 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/994c3400-0024-457d-88c7-e59b4053062c" status: 200 len: 1688 microversion: 2.1 time: 0.165449 Sep 09 16:36:43.755752 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 312/625] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:36:43 2022] GET /compute/v2.1/servers/994c3400-0024-457d-88c7-e59b4053062c => generated 1688 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:36:44.361870 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-fd71f70b-97a5-4291-a1f2-e50eb389c6ae tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:36:44.365371 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-fd71f70b-97a5-4291-a1f2-e50eb389c6ae tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: 27b503a6-c023-49fb-b11a-37da810939cf] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:36:44.375734 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-fd71f70b-97a5-4291-a1f2-e50eb389c6ae tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:44.376536 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-fd71f70b-97a5-4291-a1f2-e50eb389c6ae tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:44.377122 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-fd71f70b-97a5-4291-a1f2-e50eb389c6ae tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:44.377848 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-fd71f70b-97a5-4291-a1f2-e50eb389c6ae tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:44.378294 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-fd71f70b-97a5-4291-a1f2-e50eb389c6ae tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:44.378741 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-fd71f70b-97a5-4291-a1f2-e50eb389c6ae tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:44.408437 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-fd71f70b-97a5-4291-a1f2-e50eb389c6ae tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053476 Sep 09 16:36:44.408960 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 314/626] 10.222.0.23 () {60 vars in 1343 bytes} [Fri Sep 9 16:36:44 2022] GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 16:36:44.779301 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-656d906a-bdbd-4444-865d-0e3e9b3d0a51 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:36:44.779966 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-656d906a-bdbd-4444-865d-0e3e9b3d0a51 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: 994c3400-0024-457d-88c7-e59b4053062c] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:36:44.786471 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-656d906a-bdbd-4444-865d-0e3e9b3d0a51 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:44.787241 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-656d906a-bdbd-4444-865d-0e3e9b3d0a51 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:44.787673 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-656d906a-bdbd-4444-865d-0e3e9b3d0a51 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:44.788375 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-656d906a-bdbd-4444-865d-0e3e9b3d0a51 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:44.788820 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-656d906a-bdbd-4444-865d-0e3e9b3d0a51 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:44.789241 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-656d906a-bdbd-4444-865d-0e3e9b3d0a51 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:45.000299 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-656d906a-bdbd-4444-865d-0e3e9b3d0a51 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d86f09c6304121be2021cb5c15e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ab544d0b547919794e3efb49ba0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:36:45.008152 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-656d906a-bdbd-4444-865d-0e3e9b3d0a51 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/994c3400-0024-457d-88c7-e59b4053062c" status: 200 len: 1688 microversion: 2.1 time: 0.233860 Sep 09 16:36:45.008725 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 313/627] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:36:44 2022] GET /compute/v2.1/servers/994c3400-0024-457d-88c7-e59b4053062c => generated 1688 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:36:45.422051 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-577beb37-ff20-4a9e-b087-6261159944a1 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:36:45.424371 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-577beb37-ff20-4a9e-b087-6261159944a1 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: 27b503a6-c023-49fb-b11a-37da810939cf] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:36:45.431136 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-577beb37-ff20-4a9e-b087-6261159944a1 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:45.431666 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-577beb37-ff20-4a9e-b087-6261159944a1 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:45.432102 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-577beb37-ff20-4a9e-b087-6261159944a1 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:45.432799 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-577beb37-ff20-4a9e-b087-6261159944a1 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:45.433249 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-577beb37-ff20-4a9e-b087-6261159944a1 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:45.433667 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-577beb37-ff20-4a9e-b087-6261159944a1 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:45.465554 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-577beb37-ff20-4a9e-b087-6261159944a1 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047659 Sep 09 16:36:45.466119 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 315/628] 10.222.0.23 () {60 vars in 1343 bytes} [Fri Sep 9 16:36:45 2022] GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 16:36:45.587546 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [req-d6402ced-c093-4656-91a0-9d4d3778c28e req-dad08132-3ef0-4795-ac9b-11ea7adaacdb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "994c3400-0024-457d-88c7-e59b4053062c", "name": "network-vif-deleted", "tag": "cd3987cc-b23d-4fa7-bf49-6afa802d4f4a"}]} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:36:45.594376 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:36:45.599625 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-d6402ced-c093-4656-91a0-9d4d3778c28e req-dad08132-3ef0-4795-ac9b-11ea7adaacdb service nova] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:45.600400 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-d6402ced-c093-4656-91a0-9d4d3778c28e req-dad08132-3ef0-4795-ac9b-11ea7adaacdb service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:45.600691 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-d6402ced-c093-4656-91a0-9d4d3778c28e req-dad08132-3ef0-4795-ac9b-11ea7adaacdb service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:45.613833 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.compute.server_external_events [req-d6402ced-c093-4656-91a0-9d4d3778c28e req-dad08132-3ef0-4795-ac9b-11ea7adaacdb service nova] Creating event network-vif-deleted:cd3987cc-b23d-4fa7-bf49-6afa802d4f4a for instance 994c3400-0024-457d-88c7-e59b4053062c on hv-cinder-83124 Sep 09 16:36:45.619976 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [req-d6402ced-c093-4656-91a0-9d4d3778c28e req-dad08132-3ef0-4795-ac9b-11ea7adaacdb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035465 Sep 09 16:36:45.622933 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 314/629] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Sep 9 16:36:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:36:46.031542 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-86fe81b2-ff91-4b2f-9d30-d888f110d402 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:36:46.032153 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-86fe81b2-ff91-4b2f-9d30-d888f110d402 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: 994c3400-0024-457d-88c7-e59b4053062c] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:36:46.034228 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG dbcounter [-] [127196] Writing DB stats nova_api:SELECT=65,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:36:46.040008 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-86fe81b2-ff91-4b2f-9d30-d888f110d402 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:46.040534 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-86fe81b2-ff91-4b2f-9d30-d888f110d402 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:46.040965 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-86fe81b2-ff91-4b2f-9d30-d888f110d402 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:46.042005 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-86fe81b2-ff91-4b2f-9d30-d888f110d402 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:46.042455 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-86fe81b2-ff91-4b2f-9d30-d888f110d402 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:46.042897 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-86fe81b2-ff91-4b2f-9d30-d888f110d402 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:46.076329 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-86fe81b2-ff91-4b2f-9d30-d888f110d402 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:46.076822 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-86fe81b2-ff91-4b2f-9d30-d888f110d402 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:46.077239 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-86fe81b2-ff91-4b2f-9d30-d888f110d402 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:46.077708 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.objects.instance [None req-86fe81b2-ff91-4b2f-9d30-d888f110d402 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lazy-loading 'fault' on Instance uuid 994c3400-0024-457d-88c7-e59b4053062c {{(pid=127196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 16:36:46.181038 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-86fe81b2-ff91-4b2f-9d30-d888f110d402 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d86f09c6304121be2021cb5c15e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ab544d0b547919794e3efb49ba0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:36:46.189223 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-86fe81b2-ff91-4b2f-9d30-d888f110d402 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/994c3400-0024-457d-88c7-e59b4053062c" status: 200 len: 1335 microversion: 2.1 time: 0.161475 Sep 09 16:36:46.190028 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 316/630] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:36:46 2022] GET /compute/v2.1/servers/994c3400-0024-457d-88c7-e59b4053062c => generated 1335 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:36:46.479803 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-1411b0af-b206-476a-9a13-facca89f7412 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:36:46.482214 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-1411b0af-b206-476a-9a13-facca89f7412 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: 27b503a6-c023-49fb-b11a-37da810939cf] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:36:46.491131 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1411b0af-b206-476a-9a13-facca89f7412 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:46.491624 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1411b0af-b206-476a-9a13-facca89f7412 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:46.492087 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1411b0af-b206-476a-9a13-facca89f7412 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:46.492776 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1411b0af-b206-476a-9a13-facca89f7412 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:46.493228 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1411b0af-b206-476a-9a13-facca89f7412 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:46.493647 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1411b0af-b206-476a-9a13-facca89f7412 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:46.529051 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-1411b0af-b206-476a-9a13-facca89f7412 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054437 Sep 09 16:36:46.529599 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 315/631] 10.222.0.23 () {60 vars in 1343 bytes} [Fri Sep 9 16:36:46 2022] GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 16:36:47.217282 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-fe5244da-44ec-4879-95be-4bd5760a0a3e tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:36:47.218142 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-fe5244da-44ec-4879-95be-4bd5760a0a3e tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: 994c3400-0024-457d-88c7-e59b4053062c] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:36:47.228924 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-fe5244da-44ec-4879-95be-4bd5760a0a3e tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:47.229736 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-fe5244da-44ec-4879-95be-4bd5760a0a3e tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:47.230532 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-fe5244da-44ec-4879-95be-4bd5760a0a3e tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:47.231685 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-fe5244da-44ec-4879-95be-4bd5760a0a3e tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:47.232442 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-fe5244da-44ec-4879-95be-4bd5760a0a3e tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:47.233144 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-fe5244da-44ec-4879-95be-4bd5760a0a3e tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:47.247836 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.wsgi [None req-fe5244da-44ec-4879-95be-4bd5760a0a3e tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] HTTP exception thrown: Instance 994c3400-0024-457d-88c7-e59b4053062c could not be found. Sep 09 16:36:47.249457 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-fe5244da-44ec-4879-95be-4bd5760a0a3e tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Request method failure captured: Sep 09 16:36:47.249457 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: request: GET /compute/v2.1/servers/994c3400-0024-457d-88c7-e59b4053062c HTTP/1.1 Sep 09 16:36:47.249457 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Accept: application/json Sep 09 16:36:47.249457 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Accept-Encoding: identity Sep 09 16:36:47.249457 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Connection: close Sep 09 16:36:47.249457 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Content-Length: 0 Sep 09 16:36:47.249457 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Content-Type: application/json Sep 09 16:36:47.249457 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Host: 10.222.0.23 Sep 09 16:36:47.249457 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Openstack-System-Scope: None Sep 09 16:36:47.249457 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: User-Agent: python-urllib3/1.26.12 Sep 09 16:36:47.249457 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Auth-Token: gAAAAABjG2p-0YVzE1C54y4YHzerR9fl8ogYekOzuznZ1bfrL9kUVfW6Ih02eq7nOq40QjAAw9fvfdATGoMCwd4vVva2idcU68ciSkDoKd8Q2lSb22phiMWNOP_KzlG5zPAX_USx2tS2bKk8URzwp5NdlHntDfA3_G1B81ZhfjolUxo8_fp6MfY Sep 09 16:36:47.249457 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Domain-Id: None Sep 09 16:36:47.249457 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Domain-Name: None Sep 09 16:36:47.249457 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Identity-Status: Confirmed Sep 09 16:36:47.249457 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Is-Admin-Project: True Sep 09 16:36:47.249457 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Project-Domain-Id: default Sep 09 16:36:47.249457 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Project-Domain-Name: Default Sep 09 16:36:47.249457 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Project-Id: d21ab544d0b547919794e3efb49ba0e9 Sep 09 16:36:47.249457 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1054417282 Sep 09 16:36:47.249457 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Role: member,reader Sep 09 16:36:47.249457 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Roles: member,reader Sep 09 16:36:47.251013 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d21ab544d0b547919794e3efb49ba0e9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d21ab544d0b547919794e3efb49ba0e9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d21ab544d0b547919794e3efb49ba0e9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d21ab544d0b547919794e3efb49ba0e9"}]}] Sep 09 16:36:47.251013 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1054417282 Sep 09 16:36:47.251013 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Tenant-Id: d21ab544d0b547919794e3efb49ba0e9 Sep 09 16:36:47.251013 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1054417282 Sep 09 16:36:47.251013 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-User: tempest-ServerRescueNegativeTestJSON-1054417282-project Sep 09 16:36:47.251013 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-User-Domain-Id: default Sep 09 16:36:47.251013 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-User-Domain-Name: Default Sep 09 16:36:47.251013 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-User-Id: 67d86f09c6304121be2021cb5c15e63e Sep 09 16:36:47.251013 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1054417282-project Sep 09 16:36:47.251013 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: method: > Sep 09 16:36:47.251013 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: exception: Instance 994c3400-0024-457d-88c7-e59b4053062c could not be found. Sep 09 16:36:47.251013 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: action_args: {'id': '994c3400-0024-457d-88c7-e59b4053062c'} Sep 09 16:36:47.251908 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 16:36:47.251908 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:36:47.251908 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 16:36:47.251908 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 16:36:47.251908 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 16:36:47.251908 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 16:36:47.251908 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 16:36:47.251908 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 16:36:47.251908 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 16:36:47.251908 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 16:36:47.251908 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 994c3400-0024-457d-88c7-e59b4053062c could not be found. Sep 09 16:36:47.251908 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Sep 09 16:36:47.251908 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 16:36:47.251908 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Sep 09 16:36:47.251908 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:36:47.251908 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 16:36:47.251908 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 16:36:47.251908 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 16:36:47.251908 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 16:36:47.251908 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 16:36:47.253478 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 16:36:47.253478 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 16:36:47.253478 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 16:36:47.253478 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 16:36:47.253478 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 16:36:47.253478 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 16:36:47.253478 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 16:36:47.253478 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 994c3400-0024-457d-88c7-e59b4053062c could not be found. Sep 09 16:36:47.253478 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Sep 09 16:36:47.253478 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 16:36:47.253478 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Sep 09 16:36:47.253478 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:36:47.253478 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 16:36:47.253478 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 16:36:47.253478 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 16:36:47.253478 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 16:36:47.253478 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 994c3400-0024-457d-88c7-e59b4053062c could not be found. Sep 09 16:36:47.253478 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Sep 09 16:36:47.255151 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-fe5244da-44ec-4879-95be-4bd5760a0a3e tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Returning 404 to user: Instance 994c3400-0024-457d-88c7-e59b4053062c could not be found. {{(pid=127196) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 16:36:47.255151 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-fe5244da-44ec-4879-95be-4bd5760a0a3e tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/994c3400-0024-457d-88c7-e59b4053062c" status: 404 len: 111 microversion: 2.1 time: 0.040296 Sep 09 16:36:47.255151 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 317/632] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:36:47 2022] GET /compute/v2.1/servers/994c3400-0024-457d-88c7-e59b4053062c => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 16:36:47.259606 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-d1efe24b-556f-4362-aad8-cb5092631bc8 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '.version_select at 0x7f24fb4efaf0>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:36:47.280208 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-d1efe24b-556f-4362-aad8-cb5092631bc8 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1794755995" status: 202 len: 0 microversion: 2.1 time: 0.024444 Sep 09 16:36:47.280774 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 316/633] 10.222.0.23 () {58 vars in 1221 bytes} [Fri Sep 9 16:36:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1794755995 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 16:36:47.542744 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-b2469925-905c-4ce9-a933-74a6b83b0716 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:36:47.544812 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-b2469925-905c-4ce9-a933-74a6b83b0716 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: 27b503a6-c023-49fb-b11a-37da810939cf] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:36:47.550908 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-b2469925-905c-4ce9-a933-74a6b83b0716 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:47.551396 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-b2469925-905c-4ce9-a933-74a6b83b0716 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:47.551834 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-b2469925-905c-4ce9-a933-74a6b83b0716 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:47.552561 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-b2469925-905c-4ce9-a933-74a6b83b0716 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:47.553101 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-b2469925-905c-4ce9-a933-74a6b83b0716 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:47.553531 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-b2469925-905c-4ce9-a933-74a6b83b0716 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:47.584267 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-b2469925-905c-4ce9-a933-74a6b83b0716 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046069 Sep 09 16:36:47.584872 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 318/634] 10.222.0.23 () {60 vars in 1343 bytes} [Fri Sep 9 16:36:47 2022] GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 16:36:48.600703 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-00fdde02-fe76-489b-b294-985490e8f268 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:36:48.603976 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-00fdde02-fe76-489b-b294-985490e8f268 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: 27b503a6-c023-49fb-b11a-37da810939cf] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:36:48.613149 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-00fdde02-fe76-489b-b294-985490e8f268 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:48.613632 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-00fdde02-fe76-489b-b294-985490e8f268 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:48.614063 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-00fdde02-fe76-489b-b294-985490e8f268 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:48.614792 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-00fdde02-fe76-489b-b294-985490e8f268 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:48.615243 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-00fdde02-fe76-489b-b294-985490e8f268 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:48.615690 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-00fdde02-fe76-489b-b294-985490e8f268 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:48.619441 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:36:48.646691 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-00fdde02-fe76-489b-b294-985490e8f268 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053079 Sep 09 16:36:48.647243 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 317/635] 10.222.0.23 () {60 vars in 1343 bytes} [Fri Sep 9 16:36:48 2022] GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 16:36:49.661085 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-799f405e-a75f-4862-bec7-eecb23b6854d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:36:49.665493 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-799f405e-a75f-4862-bec7-eecb23b6854d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: 27b503a6-c023-49fb-b11a-37da810939cf] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:36:49.674670 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-799f405e-a75f-4862-bec7-eecb23b6854d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:49.675327 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-799f405e-a75f-4862-bec7-eecb23b6854d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:49.675856 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-799f405e-a75f-4862-bec7-eecb23b6854d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:49.677100 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-799f405e-a75f-4862-bec7-eecb23b6854d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:49.677928 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-799f405e-a75f-4862-bec7-eecb23b6854d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:49.678483 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-799f405e-a75f-4862-bec7-eecb23b6854d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:49.712585 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-799f405e-a75f-4862-bec7-eecb23b6854d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056103 Sep 09 16:36:49.713519 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 319/636] 10.222.0.23 () {60 vars in 1343 bytes} [Fri Sep 9 16:36:49 2022] GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 16:36:50.166081 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-e89b22b8-1ab5-494a-a151-ed18095509b3 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:36:50.167498 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-e89b22b8-1ab5-494a-a151-ed18095509b3 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: e8d23cb3-2f39-4b00-ae9d-006e392a5940] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:36:50.174048 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e89b22b8-1ab5-494a-a151-ed18095509b3 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:50.174595 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e89b22b8-1ab5-494a-a151-ed18095509b3 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:50.175028 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e89b22b8-1ab5-494a-a151-ed18095509b3 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:50.175826 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e89b22b8-1ab5-494a-a151-ed18095509b3 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:50.176268 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e89b22b8-1ab5-494a-a151-ed18095509b3 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:50.176689 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e89b22b8-1ab5-494a-a151-ed18095509b3 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:50.201748 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-e89b22b8-1ab5-494a-a151-ed18095509b3 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: e8d23cb3-2f39-4b00-ae9d-006e392a5940] Going to try to terminate instance {{(pid=127198) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 16:36:50.277947 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-e89b22b8-1ab5-494a-a151-ed18095509b3 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "DELETE /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940" status: 204 len: 0 microversion: 2.1 time: 0.115472 Sep 09 16:36:50.278548 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 318/637] 10.222.0.23 () {58 vars in 1239 bytes} [Fri Sep 9 16:36:50 2022] DELETE /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 16:36:50.286882 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-62d349bf-482c-4589-8129-396d0a433e0f tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:36:50.287484 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-62d349bf-482c-4589-8129-396d0a433e0f tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: e8d23cb3-2f39-4b00-ae9d-006e392a5940] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:36:50.294050 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-62d349bf-482c-4589-8129-396d0a433e0f tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:50.294551 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-62d349bf-482c-4589-8129-396d0a433e0f tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:50.294983 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-62d349bf-482c-4589-8129-396d0a433e0f tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:50.295665 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-62d349bf-482c-4589-8129-396d0a433e0f tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:50.296115 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-62d349bf-482c-4589-8129-396d0a433e0f tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:50.296533 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-62d349bf-482c-4589-8129-396d0a433e0f tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:50.429129 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-62d349bf-482c-4589-8129-396d0a433e0f tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d86f09c6304121be2021cb5c15e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ab544d0b547919794e3efb49ba0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:36:50.437351 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-62d349bf-482c-4589-8129-396d0a433e0f tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940" status: 200 len: 1508 microversion: 2.1 time: 0.154564 Sep 09 16:36:50.437916 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 320/638] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:36:50 2022] GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940 => generated 1508 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:36:50.729657 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-2baf8196-c952-4089-ad6c-a417f30b3bab tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:36:50.733216 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-2baf8196-c952-4089-ad6c-a417f30b3bab tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: 27b503a6-c023-49fb-b11a-37da810939cf] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:36:50.741359 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2baf8196-c952-4089-ad6c-a417f30b3bab tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:50.741835 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2baf8196-c952-4089-ad6c-a417f30b3bab tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:50.742264 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2baf8196-c952-4089-ad6c-a417f30b3bab tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:50.742980 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2baf8196-c952-4089-ad6c-a417f30b3bab tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:50.743428 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2baf8196-c952-4089-ad6c-a417f30b3bab tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:50.743834 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2baf8196-c952-4089-ad6c-a417f30b3bab tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:50.775196 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-2baf8196-c952-4089-ad6c-a417f30b3bab tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052866 Sep 09 16:36:50.775742 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 319/639] 10.222.0.23 () {60 vars in 1343 bytes} [Fri Sep 9 16:36:50 2022] GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 16:36:51.462043 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-01dacec0-1f91-4445-b490-7f579fb276fd tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:36:51.462660 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-01dacec0-1f91-4445-b490-7f579fb276fd tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: e8d23cb3-2f39-4b00-ae9d-006e392a5940] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:36:51.469612 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-01dacec0-1f91-4445-b490-7f579fb276fd tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:51.470090 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-01dacec0-1f91-4445-b490-7f579fb276fd tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:51.470528 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-01dacec0-1f91-4445-b490-7f579fb276fd tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:51.471244 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-01dacec0-1f91-4445-b490-7f579fb276fd tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:51.471697 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-01dacec0-1f91-4445-b490-7f579fb276fd tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:51.472115 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-01dacec0-1f91-4445-b490-7f579fb276fd tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:51.616344 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-01dacec0-1f91-4445-b490-7f579fb276fd tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d86f09c6304121be2021cb5c15e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ab544d0b547919794e3efb49ba0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:36:51.618539 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG dbcounter [-] [127196] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:36:51.625273 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-01dacec0-1f91-4445-b490-7f579fb276fd tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940" status: 200 len: 1508 microversion: 2.1 time: 0.167230 Sep 09 16:36:51.625848 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 321/640] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:36:51 2022] GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940 => generated 1508 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:36:51.789760 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-dacd91d3-63e2-447d-b7f6-e37160c756a8 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:36:51.793469 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-dacd91d3-63e2-447d-b7f6-e37160c756a8 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: 27b503a6-c023-49fb-b11a-37da810939cf] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:36:51.801960 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-dacd91d3-63e2-447d-b7f6-e37160c756a8 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:51.802796 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-dacd91d3-63e2-447d-b7f6-e37160c756a8 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:51.803475 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-dacd91d3-63e2-447d-b7f6-e37160c756a8 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:51.804389 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-dacd91d3-63e2-447d-b7f6-e37160c756a8 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:51.804814 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-dacd91d3-63e2-447d-b7f6-e37160c756a8 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:51.805250 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-dacd91d3-63e2-447d-b7f6-e37160c756a8 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:51.836398 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-dacd91d3-63e2-447d-b7f6-e37160c756a8 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051803 Sep 09 16:36:51.836946 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 320/641] 10.222.0.23 () {60 vars in 1343 bytes} [Fri Sep 9 16:36:51 2022] GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 16:36:52.652299 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-d7d8860c-c7d0-44d6-aee1-d82e8859b1db tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:36:52.653228 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-d7d8860c-c7d0-44d6-aee1-d82e8859b1db tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: e8d23cb3-2f39-4b00-ae9d-006e392a5940] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:36:52.663605 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-d7d8860c-c7d0-44d6-aee1-d82e8859b1db tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:52.664009 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-d7d8860c-c7d0-44d6-aee1-d82e8859b1db tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:52.664447 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-d7d8860c-c7d0-44d6-aee1-d82e8859b1db tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:52.665137 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-d7d8860c-c7d0-44d6-aee1-d82e8859b1db tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:52.665589 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-d7d8860c-c7d0-44d6-aee1-d82e8859b1db tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:52.666012 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-d7d8860c-c7d0-44d6-aee1-d82e8859b1db tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:52.798445 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-d7d8860c-c7d0-44d6-aee1-d82e8859b1db tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d86f09c6304121be2021cb5c15e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ab544d0b547919794e3efb49ba0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:36:52.806300 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-d7d8860c-c7d0-44d6-aee1-d82e8859b1db tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940" status: 200 len: 1508 microversion: 2.1 time: 0.160788 Sep 09 16:36:52.806905 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 322/642] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:36:52 2022] GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940 => generated 1508 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:36:52.852151 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-994fe2ec-6e36-402b-a902-3b66a8750a05 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:36:52.854633 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-994fe2ec-6e36-402b-a902-3b66a8750a05 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: 27b503a6-c023-49fb-b11a-37da810939cf] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:36:52.861400 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-994fe2ec-6e36-402b-a902-3b66a8750a05 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:52.861860 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-994fe2ec-6e36-402b-a902-3b66a8750a05 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:52.862291 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-994fe2ec-6e36-402b-a902-3b66a8750a05 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:52.863008 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-994fe2ec-6e36-402b-a902-3b66a8750a05 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:52.863452 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-994fe2ec-6e36-402b-a902-3b66a8750a05 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:52.863866 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-994fe2ec-6e36-402b-a902-3b66a8750a05 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:52.897779 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-994fe2ec-6e36-402b-a902-3b66a8750a05 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049825 Sep 09 16:36:52.898342 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 321/643] 10.222.0.23 () {60 vars in 1343 bytes} [Fri Sep 9 16:36:52 2022] GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 16:36:53.468141 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-88d011c6-738c-42a7-a068-48d26762048e tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "75b25113-e122-4a6c-9189-e13acc7f2d5e"}} {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:36:53.470671 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-88d011c6-738c-42a7-a068-48d26762048e tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] [instance: 11fefdc7-238f-4580-96f8-d4ba861abeea] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:36:53.477478 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-88d011c6-738c-42a7-a068-48d26762048e tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:53.477928 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-88d011c6-738c-42a7-a068-48d26762048e tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:53.478360 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-88d011c6-738c-42a7-a068-48d26762048e tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:53.479281 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-88d011c6-738c-42a7-a068-48d26762048e tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:53.479699 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-88d011c6-738c-42a7-a068-48d26762048e tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:53.480114 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-88d011c6-738c-42a7-a068-48d26762048e tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:53.567051 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.wsgi [None req-88d011c6-738c-42a7-a068-48d26762048e tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] HTTP exception thrown: Invalid volume: volume 75b25113-e122-4a6c-9189-e13acc7f2d5e is already attached to instances: 11fefdc7-238f-4580-96f8-d4ba861abeea Sep 09 16:36:53.569050 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-88d011c6-738c-42a7-a068-48d26762048e tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Request method failure captured: Sep 09 16:36:53.569050 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: request: POST /compute/v2.1/servers/11fefdc7-238f-4580-96f8-d4ba861abeea/os-volume_attachments HTTP/1.1 Sep 09 16:36:53.569050 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Accept: application/json Sep 09 16:36:53.569050 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Accept-Encoding: identity Sep 09 16:36:53.569050 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Connection: close Sep 09 16:36:53.569050 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Content-Length: 74 Sep 09 16:36:53.569050 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Content-Type: application/json Sep 09 16:36:53.569050 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Host: 10.222.0.23 Sep 09 16:36:53.569050 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Openstack-System-Scope: None Sep 09 16:36:53.569050 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: User-Agent: python-urllib3/1.26.12 Sep 09 16:36:53.569050 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Auth-Token: gAAAAABjG2p8X7ru_JB5hJR44VQ2gJJ5-pnimmT3rRqiF7PaDSUV6TptFJkJ5B7Brlh3RUo94RsnCU-lX7lENCapIWQjRtP9b5hcyxC2h1lMkUs_mIUD6GO84yl6hoSKhKDmYwez2Ale62nt_G9YgAJhsj7sSTM8MyBYvPk9Cs4OYzLEWXRgGoo Sep 09 16:36:53.569050 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Domain-Id: None Sep 09 16:36:53.569050 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Domain-Name: None Sep 09 16:36:53.569050 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Identity-Status: Confirmed Sep 09 16:36:53.569050 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Is-Admin-Project: True Sep 09 16:36:53.569050 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Project-Domain-Id: default Sep 09 16:36:53.569050 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Project-Domain-Name: Default Sep 09 16:36:53.569050 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Project-Id: e17967a941be4a04bbc180e2cf3a7a55 Sep 09 16:36:53.569050 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Project-Name: tempest-AttachVolumeNegativeTest-456905727 Sep 09 16:36:53.569050 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Role: member,reader Sep 09 16:36:53.569050 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Roles: member,reader Sep 09 16:36:53.570327 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e17967a941be4a04bbc180e2cf3a7a55"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e17967a941be4a04bbc180e2cf3a7a55"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e17967a941be4a04bbc180e2cf3a7a55"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e17967a941be4a04bbc180e2cf3a7a55"}]}] Sep 09 16:36:53.570327 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Tenant: tempest-AttachVolumeNegativeTest-456905727 Sep 09 16:36:53.570327 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Tenant-Id: e17967a941be4a04bbc180e2cf3a7a55 Sep 09 16:36:53.570327 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-456905727 Sep 09 16:36:53.570327 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-User: tempest-AttachVolumeNegativeTest-456905727-project Sep 09 16:36:53.570327 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-User-Domain-Id: default Sep 09 16:36:53.570327 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-User-Domain-Name: Default Sep 09 16:36:53.570327 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-User-Id: 53c0721dc18343b18993ff5af098841d Sep 09 16:36:53.570327 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-User-Name: tempest-AttachVolumeNegativeTest-456905727-project Sep 09 16:36:53.570327 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Sep 09 16:36:53.570327 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: {"volumeAttachment": {"volumeId": "75b25113-e122-4a6c-9189-e13acc7f2d5e"}} Sep 09 16:36:53.570327 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: method: > Sep 09 16:36:53.571090 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: exception: Invalid volume: volume 75b25113-e122-4a6c-9189-e13acc7f2d5e is already attached to instances: 11fefdc7-238f-4580-96f8-d4ba861abeea Sep 09 16:36:53.571090 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: action_args: {'server_id': '11fefdc7-238f-4580-96f8-d4ba861abeea', 'body': {'volumeAttachment': {'volumeId': '75b25113-e122-4a6c-9189-e13acc7f2d5e'}}} Sep 09 16:36:53.571090 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 16:36:53.571090 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:36:53.571090 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 09 16:36:53.571090 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 09 16:36:53.571090 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 09 16:36:53.571090 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 09 16:36:53.571090 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 09 16:36:53.571090 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 09 16:36:53.571090 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 09 16:36:53.571090 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 09 16:36:53.571090 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 09 16:36:53.571090 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 09 16:36:53.571090 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 75b25113-e122-4a6c-9189-e13acc7f2d5e is already attached to instances: 11fefdc7-238f-4580-96f8-d4ba861abeea Sep 09 16:36:53.571090 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Sep 09 16:36:53.571090 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 16:36:53.571090 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Sep 09 16:36:53.571090 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:36:53.572210 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 16:36:53.572210 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 16:36:53.572210 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 16:36:53.572210 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 16:36:53.572210 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 16:36:53.572210 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 16:36:53.572210 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 09 16:36:53.572210 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 16:36:53.572210 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 09 16:36:53.572210 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 16:36:53.572210 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 09 16:36:53.572210 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 16:36:53.572210 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 09 16:36:53.572210 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 09 16:36:53.572210 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 75b25113-e122-4a6c-9189-e13acc7f2d5e is already attached to instances: 11fefdc7-238f-4580-96f8-d4ba861abeea Sep 09 16:36:53.572210 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Sep 09 16:36:53.572210 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 16:36:53.572210 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Sep 09 16:36:53.572210 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:36:53.572210 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 16:36:53.573345 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 16:36:53.573345 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 16:36:53.573345 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 16:36:53.573345 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 75b25113-e122-4a6c-9189-e13acc7f2d5e is already attached to instances: 11fefdc7-238f-4580-96f8-d4ba861abeea Sep 09 16:36:53.573345 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Sep 09 16:36:53.575129 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-88d011c6-738c-42a7-a068-48d26762048e tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Returning 400 to user: Invalid volume: volume 75b25113-e122-4a6c-9189-e13acc7f2d5e is already attached to instances: 11fefdc7-238f-4580-96f8-d4ba861abeea {{(pid=127196) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 16:36:53.576203 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-88d011c6-738c-42a7-a068-48d26762048e tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] 10.222.0.23 "POST /compute/v2.1/servers/11fefdc7-238f-4580-96f8-d4ba861abeea/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.112350 Sep 09 16:36:53.576996 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 323/644] 10.222.0.23 () {60 vars in 1323 bytes} [Fri Sep 9 16:36:53 2022] POST /compute/v2.1/servers/11fefdc7-238f-4580-96f8-d4ba861abeea/os-volume_attachments => generated 174 bytes in 114 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 09 16:36:53.651256 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [req-7ae8c104-caca-4abd-bafa-9861872dcdaa req-515fa402-8d20-40f5-b3a9-f5a8ba4f321a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8d23cb3-2f39-4b00-ae9d-006e392a5940", "name": "network-vif-deleted", "tag": "98eca583-6399-4702-a0d5-6321d1da9439"}]} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:36:53.660489 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-7ae8c104-caca-4abd-bafa-9861872dcdaa req-515fa402-8d20-40f5-b3a9-f5a8ba4f321a service nova] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:53.661222 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-7ae8c104-caca-4abd-bafa-9861872dcdaa req-515fa402-8d20-40f5-b3a9-f5a8ba4f321a service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:53.661644 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-7ae8c104-caca-4abd-bafa-9861872dcdaa req-515fa402-8d20-40f5-b3a9-f5a8ba4f321a service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:53.664840 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-6e23866f-f180-4ab0-ae41-196ebee01d57 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:36:53.665335 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-6e23866f-f180-4ab0-ae41-196ebee01d57 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] [instance: 11fefdc7-238f-4580-96f8-d4ba861abeea] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:36:53.672892 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-6e23866f-f180-4ab0-ae41-196ebee01d57 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:53.673375 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-6e23866f-f180-4ab0-ae41-196ebee01d57 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:53.673998 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-6e23866f-f180-4ab0-ae41-196ebee01d57 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:53.674130 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.compute.server_external_events [req-7ae8c104-caca-4abd-bafa-9861872dcdaa req-515fa402-8d20-40f5-b3a9-f5a8ba4f321a service nova] Creating event network-vif-deleted:98eca583-6399-4702-a0d5-6321d1da9439 for instance e8d23cb3-2f39-4b00-ae9d-006e392a5940 on hv-cinder-83124 Sep 09 16:36:53.674793 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-6e23866f-f180-4ab0-ae41-196ebee01d57 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:53.675254 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-6e23866f-f180-4ab0-ae41-196ebee01d57 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:53.675679 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-6e23866f-f180-4ab0-ae41-196ebee01d57 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:53.679047 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [req-7ae8c104-caca-4abd-bafa-9861872dcdaa req-515fa402-8d20-40f5-b3a9-f5a8ba4f321a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031706 Sep 09 16:36:53.679642 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 322/645] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Sep 9 16:36:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 16:36:53.808611 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.objects.instance [None req-6e23866f-f180-4ab0-ae41-196ebee01d57 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lazy-loading 'services' on Instance uuid 11fefdc7-238f-4580-96f8-d4ba861abeea {{(pid=127196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 16:36:53.830033 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-9d5985bd-5990-4c62-a12e-4eca2c55282f tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:36:53.830770 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-9d5985bd-5990-4c62-a12e-4eca2c55282f tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: e8d23cb3-2f39-4b00-ae9d-006e392a5940] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:36:53.836981 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9d5985bd-5990-4c62-a12e-4eca2c55282f tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:53.837543 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9d5985bd-5990-4c62-a12e-4eca2c55282f tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:53.838029 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9d5985bd-5990-4c62-a12e-4eca2c55282f tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:53.838879 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9d5985bd-5990-4c62-a12e-4eca2c55282f tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:53.839362 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9d5985bd-5990-4c62-a12e-4eca2c55282f tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:53.839863 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9d5985bd-5990-4c62-a12e-4eca2c55282f tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:53.879351 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9d5985bd-5990-4c62-a12e-4eca2c55282f tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:53.880025 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9d5985bd-5990-4c62-a12e-4eca2c55282f tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:53.880288 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9d5985bd-5990-4c62-a12e-4eca2c55282f tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:53.880730 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.objects.instance [None req-9d5985bd-5990-4c62-a12e-4eca2c55282f tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lazy-loading 'fault' on Instance uuid e8d23cb3-2f39-4b00-ae9d-006e392a5940 {{(pid=127198) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 16:36:53.928226 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-9d5985bd-5990-4c62-a12e-4eca2c55282f tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d86f09c6304121be2021cb5c15e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ab544d0b547919794e3efb49ba0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:36:53.928562 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-6e23866f-f180-4ab0-ae41-196ebee01d57 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] 10.222.0.23 "DELETE /compute/v2.1/servers/11fefdc7-238f-4580-96f8-d4ba861abeea/os-volume_attachments/75b25113-e122-4a6c-9189-e13acc7f2d5e" status: 202 len: 0 microversion: 2.1 time: 0.267485 Sep 09 16:36:53.932378 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 324/646] 10.222.0.23 () {58 vars in 1416 bytes} [Fri Sep 9 16:36:53 2022] DELETE /compute/v2.1/servers/11fefdc7-238f-4580-96f8-d4ba861abeea/os-volume_attachments/75b25113-e122-4a6c-9189-e13acc7f2d5e => generated 0 bytes in 269 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 09 16:36:53.934837 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-48ce723c-7129-4496-874a-3dbdc9558599 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:36:53.936428 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-9d5985bd-5990-4c62-a12e-4eca2c55282f tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940" status: 200 len: 1312 microversion: 2.1 time: 0.110795 Sep 09 16:36:53.937004 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 323/647] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:36:53 2022] GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940 => generated 1312 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:36:53.942441 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-8997c50a-be63-465e-96ff-bc72781790ab tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:36:53.944570 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-8997c50a-be63-465e-96ff-bc72781790ab tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] [instance: 11fefdc7-238f-4580-96f8-d4ba861abeea] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:36:53.946963 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-48ce723c-7129-4496-874a-3dbdc9558599 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: 27b503a6-c023-49fb-b11a-37da810939cf] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:36:53.954770 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-48ce723c-7129-4496-874a-3dbdc9558599 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:53.955396 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-48ce723c-7129-4496-874a-3dbdc9558599 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:53.955891 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-48ce723c-7129-4496-874a-3dbdc9558599 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:53.956644 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-48ce723c-7129-4496-874a-3dbdc9558599 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:53.957101 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-48ce723c-7129-4496-874a-3dbdc9558599 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:53.957622 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-48ce723c-7129-4496-874a-3dbdc9558599 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:53.965765 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8997c50a-be63-465e-96ff-bc72781790ab tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:53.966254 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8997c50a-be63-465e-96ff-bc72781790ab tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:53.966755 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8997c50a-be63-465e-96ff-bc72781790ab tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:53.967485 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8997c50a-be63-465e-96ff-bc72781790ab tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:53.967926 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8997c50a-be63-465e-96ff-bc72781790ab tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:53.968345 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8997c50a-be63-465e-96ff-bc72781790ab tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:54.001186 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-8997c50a-be63-465e-96ff-bc72781790ab tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] 10.222.0.23 "GET /compute/v2.1/servers/11fefdc7-238f-4580-96f8-d4ba861abeea/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062836 Sep 09 16:36:54.006595 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 324/648] 10.222.0.23 () {58 vars in 1302 bytes} [Fri Sep 9 16:36:53 2022] GET /compute/v2.1/servers/11fefdc7-238f-4580-96f8-d4ba861abeea/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:36:54.012353 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-48ce723c-7129-4496-874a-3dbdc9558599 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.081999 Sep 09 16:36:54.012926 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 325/649] 10.222.0.23 () {60 vars in 1343 bytes} [Fri Sep 9 16:36:53 2022] GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf/os-volume_attachments => generated 25 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:36:54.089545 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-0fe463ce-f9c3-4dfa-bb43-2d5213b3c7a5 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:36:54.090036 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-0fe463ce-f9c3-4dfa-bb43-2d5213b3c7a5 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: 27b503a6-c023-49fb-b11a-37da810939cf] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:36:54.096142 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0fe463ce-f9c3-4dfa-bb43-2d5213b3c7a5 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:54.096612 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0fe463ce-f9c3-4dfa-bb43-2d5213b3c7a5 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:54.097041 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0fe463ce-f9c3-4dfa-bb43-2d5213b3c7a5 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:54.097727 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0fe463ce-f9c3-4dfa-bb43-2d5213b3c7a5 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:54.098216 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0fe463ce-f9c3-4dfa-bb43-2d5213b3c7a5 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:54.098700 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0fe463ce-f9c3-4dfa-bb43-2d5213b3c7a5 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:54.124468 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-0fe463ce-f9c3-4dfa-bb43-2d5213b3c7a5 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: 27b503a6-c023-49fb-b11a-37da810939cf] Going to try to terminate instance {{(pid=127198) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 16:36:54.202686 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-0fe463ce-f9c3-4dfa-bb43-2d5213b3c7a5 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "DELETE /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf" status: 204 len: 0 microversion: 2.20 time: 0.116761 Sep 09 16:36:54.203222 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 325/650] 10.222.0.23 () {60 vars in 1280 bytes} [Fri Sep 9 16:36:54 2022] DELETE /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 09 16:36:54.211608 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-6a88e66b-cf7a-4c14-aab3-a8b6347f34d3 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:36:54.212252 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-6a88e66b-cf7a-4c14-aab3-a8b6347f34d3 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: 27b503a6-c023-49fb-b11a-37da810939cf] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:36:54.219051 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-6a88e66b-cf7a-4c14-aab3-a8b6347f34d3 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:54.219525 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-6a88e66b-cf7a-4c14-aab3-a8b6347f34d3 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:54.219955 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-6a88e66b-cf7a-4c14-aab3-a8b6347f34d3 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:54.220687 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-6a88e66b-cf7a-4c14-aab3-a8b6347f34d3 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:54.221139 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-6a88e66b-cf7a-4c14-aab3-a8b6347f34d3 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:54.221548 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-6a88e66b-cf7a-4c14-aab3-a8b6347f34d3 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:54.364920 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-6a88e66b-cf7a-4c14-aab3-a8b6347f34d3 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:36:54.375344 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-6a88e66b-cf7a-4c14-aab3-a8b6347f34d3 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:36:54.376783 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-6a88e66b-cf7a-4c14-aab3-a8b6347f34d3 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:36:54.378105 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-6a88e66b-cf7a-4c14-aab3-a8b6347f34d3 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf" status: 200 len: 1723 microversion: 2.20 time: 0.170499 Sep 09 16:36:54.378811 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 326/651] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Sep 9 16:36:54 2022] GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 16:36:54.965788 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-a7b38479-ddfa-41d8-9b4f-60ab05979172 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:36:54.967002 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-a7b38479-ddfa-41d8-9b4f-60ab05979172 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: e8d23cb3-2f39-4b00-ae9d-006e392a5940] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:36:54.976187 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a7b38479-ddfa-41d8-9b4f-60ab05979172 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:54.976671 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a7b38479-ddfa-41d8-9b4f-60ab05979172 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:54.977106 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a7b38479-ddfa-41d8-9b4f-60ab05979172 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:54.977792 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a7b38479-ddfa-41d8-9b4f-60ab05979172 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:54.978247 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a7b38479-ddfa-41d8-9b4f-60ab05979172 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:54.978707 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a7b38479-ddfa-41d8-9b4f-60ab05979172 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:55.010186 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a7b38479-ddfa-41d8-9b4f-60ab05979172 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:55.010674 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a7b38479-ddfa-41d8-9b4f-60ab05979172 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:55.011123 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a7b38479-ddfa-41d8-9b4f-60ab05979172 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:55.011563 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.objects.instance [None req-a7b38479-ddfa-41d8-9b4f-60ab05979172 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lazy-loading 'fault' on Instance uuid e8d23cb3-2f39-4b00-ae9d-006e392a5940 {{(pid=127198) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 16:36:55.013792 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-bd6e4e75-02b8-414a-beeb-4cef4bf72dde tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:36:55.016467 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-bd6e4e75-02b8-414a-beeb-4cef4bf72dde tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] [instance: 11fefdc7-238f-4580-96f8-d4ba861abeea] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:36:55.023124 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-bd6e4e75-02b8-414a-beeb-4cef4bf72dde tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:55.023722 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-bd6e4e75-02b8-414a-beeb-4cef4bf72dde tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:55.024157 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-bd6e4e75-02b8-414a-beeb-4cef4bf72dde tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:55.024840 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-bd6e4e75-02b8-414a-beeb-4cef4bf72dde tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:55.025291 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-bd6e4e75-02b8-414a-beeb-4cef4bf72dde tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:55.025698 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-bd6e4e75-02b8-414a-beeb-4cef4bf72dde tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:55.055376 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-a7b38479-ddfa-41d8-9b4f-60ab05979172 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d86f09c6304121be2021cb5c15e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ab544d0b547919794e3efb49ba0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:36:55.058041 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-bd6e4e75-02b8-414a-beeb-4cef4bf72dde tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] 10.222.0.23 "GET /compute/v2.1/servers/11fefdc7-238f-4580-96f8-d4ba861abeea/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048350 Sep 09 16:36:55.058909 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 327/652] 10.222.0.23 () {58 vars in 1302 bytes} [Fri Sep 9 16:36:55 2022] GET /compute/v2.1/servers/11fefdc7-238f-4580-96f8-d4ba861abeea/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:36:55.063587 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-a7b38479-ddfa-41d8-9b4f-60ab05979172 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940" status: 200 len: 1312 microversion: 2.1 time: 0.105053 Sep 09 16:36:55.064152 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 326/653] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:36:54 2022] GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940 => generated 1312 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:36:55.409038 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-52cc762b-58de-4617-bb01-b34aa31c6c09 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:36:55.410079 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-52cc762b-58de-4617-bb01-b34aa31c6c09 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: 27b503a6-c023-49fb-b11a-37da810939cf] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:36:55.420517 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-52cc762b-58de-4617-bb01-b34aa31c6c09 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:55.421327 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-52cc762b-58de-4617-bb01-b34aa31c6c09 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:55.422063 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-52cc762b-58de-4617-bb01-b34aa31c6c09 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:55.423242 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-52cc762b-58de-4617-bb01-b34aa31c6c09 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:55.423997 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-52cc762b-58de-4617-bb01-b34aa31c6c09 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:55.424699 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-52cc762b-58de-4617-bb01-b34aa31c6c09 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:55.557489 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-52cc762b-58de-4617-bb01-b34aa31c6c09 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:36:55.565830 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-52cc762b-58de-4617-bb01-b34aa31c6c09 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:36:55.567429 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-52cc762b-58de-4617-bb01-b34aa31c6c09 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:36:55.568585 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-52cc762b-58de-4617-bb01-b34aa31c6c09 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf" status: 200 len: 1723 microversion: 2.20 time: 0.166326 Sep 09 16:36:55.569145 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 328/654] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Sep 9 16:36:55 2022] GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 16:36:56.075199 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-3efb15c9-aacb-489e-b8ed-122699e85751 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:36:56.080469 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-3efb15c9-aacb-489e-b8ed-122699e85751 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] [instance: 11fefdc7-238f-4580-96f8-d4ba861abeea] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:36:56.088523 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-a42e4e49-6ddf-42d9-8a81-df45a875c593 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:36:56.089135 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-a42e4e49-6ddf-42d9-8a81-df45a875c593 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: e8d23cb3-2f39-4b00-ae9d-006e392a5940] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:36:56.090831 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3efb15c9-aacb-489e-b8ed-122699e85751 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:56.091363 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3efb15c9-aacb-489e-b8ed-122699e85751 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:56.091755 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3efb15c9-aacb-489e-b8ed-122699e85751 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:56.092499 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3efb15c9-aacb-489e-b8ed-122699e85751 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:56.092926 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3efb15c9-aacb-489e-b8ed-122699e85751 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:56.093333 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3efb15c9-aacb-489e-b8ed-122699e85751 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:56.095989 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-a42e4e49-6ddf-42d9-8a81-df45a875c593 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:56.096473 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-a42e4e49-6ddf-42d9-8a81-df45a875c593 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:56.096900 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-a42e4e49-6ddf-42d9-8a81-df45a875c593 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:56.097586 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-a42e4e49-6ddf-42d9-8a81-df45a875c593 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:56.098035 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-a42e4e49-6ddf-42d9-8a81-df45a875c593 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:56.098580 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-a42e4e49-6ddf-42d9-8a81-df45a875c593 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:56.123257 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-3efb15c9-aacb-489e-b8ed-122699e85751 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] 10.222.0.23 "GET /compute/v2.1/servers/11fefdc7-238f-4580-96f8-d4ba861abeea/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054881 Sep 09 16:36:56.123821 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 327/655] 10.222.0.23 () {58 vars in 1302 bytes} [Fri Sep 9 16:36:56 2022] GET /compute/v2.1/servers/11fefdc7-238f-4580-96f8-d4ba861abeea/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:36:56.129444 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-a42e4e49-6ddf-42d9-8a81-df45a875c593 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:56.129940 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-a42e4e49-6ddf-42d9-8a81-df45a875c593 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:56.130384 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-a42e4e49-6ddf-42d9-8a81-df45a875c593 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:56.130824 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.objects.instance [None req-a42e4e49-6ddf-42d9-8a81-df45a875c593 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lazy-loading 'fault' on Instance uuid e8d23cb3-2f39-4b00-ae9d-006e392a5940 {{(pid=127196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 16:36:56.177096 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-a42e4e49-6ddf-42d9-8a81-df45a875c593 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d86f09c6304121be2021cb5c15e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ab544d0b547919794e3efb49ba0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:36:56.185154 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-a42e4e49-6ddf-42d9-8a81-df45a875c593 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940" status: 200 len: 1312 microversion: 2.1 time: 0.100904 Sep 09 16:36:56.185693 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 329/656] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:36:56 2022] GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940 => generated 1312 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:36:56.593412 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-f5866ae4-5035-4dc6-8dd2-914c277dbb2c tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:36:56.594112 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-f5866ae4-5035-4dc6-8dd2-914c277dbb2c tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: 27b503a6-c023-49fb-b11a-37da810939cf] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:36:56.601201 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f5866ae4-5035-4dc6-8dd2-914c277dbb2c tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:56.601768 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f5866ae4-5035-4dc6-8dd2-914c277dbb2c tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:56.602267 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f5866ae4-5035-4dc6-8dd2-914c277dbb2c tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:56.603046 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f5866ae4-5035-4dc6-8dd2-914c277dbb2c tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:56.603563 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f5866ae4-5035-4dc6-8dd2-914c277dbb2c tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:56.604101 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f5866ae4-5035-4dc6-8dd2-914c277dbb2c tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:56.739453 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-f5866ae4-5035-4dc6-8dd2-914c277dbb2c tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:36:56.748050 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-f5866ae4-5035-4dc6-8dd2-914c277dbb2c tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:36:56.749481 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-f5866ae4-5035-4dc6-8dd2-914c277dbb2c tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:36:56.750660 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-f5866ae4-5035-4dc6-8dd2-914c277dbb2c tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf" status: 200 len: 1723 microversion: 2.20 time: 0.161271 Sep 09 16:36:56.751218 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 328/657] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Sep 9 16:36:56 2022] GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 16:36:57.196503 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [req-6c4eb4e6-5ad1-4f90-afaa-93864551d064 req-e856f0c6-736e-491e-9609-6972e1730be2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27b503a6-c023-49fb-b11a-37da810939cf", "name": "network-vif-deleted", "tag": "56079a62-4748-409c-b913-eb3925499a09"}]} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:36:57.209714 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-6c4eb4e6-5ad1-4f90-afaa-93864551d064 req-e856f0c6-736e-491e-9609-6972e1730be2 service nova] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:57.218050 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-6c4eb4e6-5ad1-4f90-afaa-93864551d064 req-e856f0c6-736e-491e-9609-6972e1730be2 service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:57.218872 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-6c4eb4e6-5ad1-4f90-afaa-93864551d064 req-e856f0c6-736e-491e-9609-6972e1730be2 service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:57.239098 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.compute.server_external_events [req-6c4eb4e6-5ad1-4f90-afaa-93864551d064 req-e856f0c6-736e-491e-9609-6972e1730be2 service nova] Creating event network-vif-deleted:56079a62-4748-409c-b913-eb3925499a09 for instance 27b503a6-c023-49fb-b11a-37da810939cf on hv-cinder-83124 Sep 09 16:36:57.247301 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [req-6c4eb4e6-5ad1-4f90-afaa-93864551d064 req-e856f0c6-736e-491e-9609-6972e1730be2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053877 Sep 09 16:36:57.249562 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 329/658] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Sep 9 16:36:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 16:36:57.275415 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-e007da76-feee-42a2-87cc-a434ad56936a tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:36:57.276568 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-e007da76-feee-42a2-87cc-a434ad56936a tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: e8d23cb3-2f39-4b00-ae9d-006e392a5940] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:36:57.285182 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e007da76-feee-42a2-87cc-a434ad56936a tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:57.286561 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e007da76-feee-42a2-87cc-a434ad56936a tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:57.288161 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e007da76-feee-42a2-87cc-a434ad56936a tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:57.289261 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e007da76-feee-42a2-87cc-a434ad56936a tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:57.290179 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e007da76-feee-42a2-87cc-a434ad56936a tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:57.291672 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e007da76-feee-42a2-87cc-a434ad56936a tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:57.321090 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.wsgi [None req-e007da76-feee-42a2-87cc-a434ad56936a tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] HTTP exception thrown: Instance e8d23cb3-2f39-4b00-ae9d-006e392a5940 could not be found. Sep 09 16:36:57.322909 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-e007da76-feee-42a2-87cc-a434ad56936a tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Request method failure captured: Sep 09 16:36:57.322909 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: request: GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940 HTTP/1.1 Sep 09 16:36:57.322909 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Accept: application/json Sep 09 16:36:57.322909 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Accept-Encoding: identity Sep 09 16:36:57.322909 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Connection: close Sep 09 16:36:57.322909 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Content-Length: 0 Sep 09 16:36:57.322909 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Content-Type: application/json Sep 09 16:36:57.322909 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Host: 10.222.0.23 Sep 09 16:36:57.322909 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Openstack-System-Scope: None Sep 09 16:36:57.322909 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: User-Agent: python-urllib3/1.26.12 Sep 09 16:36:57.322909 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Auth-Token: gAAAAABjG2p-0YVzE1C54y4YHzerR9fl8ogYekOzuznZ1bfrL9kUVfW6Ih02eq7nOq40QjAAw9fvfdATGoMCwd4vVva2idcU68ciSkDoKd8Q2lSb22phiMWNOP_KzlG5zPAX_USx2tS2bKk8URzwp5NdlHntDfA3_G1B81ZhfjolUxo8_fp6MfY Sep 09 16:36:57.322909 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Domain-Id: None Sep 09 16:36:57.322909 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Domain-Name: None Sep 09 16:36:57.322909 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Identity-Status: Confirmed Sep 09 16:36:57.322909 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Is-Admin-Project: True Sep 09 16:36:57.322909 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Project-Domain-Id: default Sep 09 16:36:57.322909 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Project-Domain-Name: Default Sep 09 16:36:57.322909 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Project-Id: d21ab544d0b547919794e3efb49ba0e9 Sep 09 16:36:57.322909 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1054417282 Sep 09 16:36:57.322909 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Role: member,reader Sep 09 16:36:57.322909 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Roles: member,reader Sep 09 16:36:57.324230 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d21ab544d0b547919794e3efb49ba0e9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d21ab544d0b547919794e3efb49ba0e9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d21ab544d0b547919794e3efb49ba0e9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d21ab544d0b547919794e3efb49ba0e9"}]}] Sep 09 16:36:57.324230 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1054417282 Sep 09 16:36:57.324230 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Tenant-Id: d21ab544d0b547919794e3efb49ba0e9 Sep 09 16:36:57.324230 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1054417282 Sep 09 16:36:57.324230 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User: tempest-ServerRescueNegativeTestJSON-1054417282-project Sep 09 16:36:57.324230 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User-Domain-Id: default Sep 09 16:36:57.324230 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User-Domain-Name: Default Sep 09 16:36:57.324230 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User-Id: 67d86f09c6304121be2021cb5c15e63e Sep 09 16:36:57.324230 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1054417282-project Sep 09 16:36:57.324230 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: method: > Sep 09 16:36:57.324230 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: exception: Instance e8d23cb3-2f39-4b00-ae9d-006e392a5940 could not be found. Sep 09 16:36:57.324230 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: action_args: {'id': 'e8d23cb3-2f39-4b00-ae9d-006e392a5940'} Sep 09 16:36:57.325106 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 16:36:57.325106 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:36:57.325106 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 16:36:57.325106 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 16:36:57.325106 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 16:36:57.325106 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 16:36:57.325106 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 16:36:57.325106 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 16:36:57.325106 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 16:36:57.325106 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 16:36:57.325106 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8d23cb3-2f39-4b00-ae9d-006e392a5940 could not be found. Sep 09 16:36:57.325106 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:36:57.325106 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 16:36:57.325106 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:36:57.325106 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:36:57.325106 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 16:36:57.325106 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 16:36:57.325106 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 16:36:57.325106 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 16:36:57.325106 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 16:36:57.326289 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 16:36:57.326289 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 16:36:57.326289 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 16:36:57.326289 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 16:36:57.326289 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 16:36:57.326289 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 16:36:57.326289 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 16:36:57.326289 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8d23cb3-2f39-4b00-ae9d-006e392a5940 could not be found. Sep 09 16:36:57.326289 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:36:57.326289 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 16:36:57.326289 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:36:57.326289 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:36:57.326289 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 16:36:57.326289 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 16:36:57.326289 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 16:36:57.326289 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 16:36:57.326289 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8d23cb3-2f39-4b00-ae9d-006e392a5940 could not be found. Sep 09 16:36:57.326289 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:36:57.329767 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-e007da76-feee-42a2-87cc-a434ad56936a tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Returning 404 to user: Instance e8d23cb3-2f39-4b00-ae9d-006e392a5940 could not be found. {{(pid=127198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 16:36:57.329767 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-e007da76-feee-42a2-87cc-a434ad56936a tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940" status: 404 len: 111 microversion: 2.1 time: 0.073359 Sep 09 16:36:57.329767 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 330/659] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:36:57 2022] GET /compute/v2.1/servers/e8d23cb3-2f39-4b00-ae9d-006e392a5940 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 16:36:57.339825 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-7670f073-fa88-4072-a617-b92a3643b4b8 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:36:57.341767 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-7670f073-fa88-4072-a617-b92a3643b4b8 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: cc41312a-3de8-4584-9bcf-a1f31b952025] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:36:57.349832 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-7c343ee0-1d36-41ce-a88a-6c01efde8df1 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:36:57.353515 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-7c343ee0-1d36-41ce-a88a-6c01efde8df1 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] [instance: 11fefdc7-238f-4580-96f8-d4ba861abeea] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:36:57.367502 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-7c343ee0-1d36-41ce-a88a-6c01efde8df1 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:57.368329 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7670f073-fa88-4072-a617-b92a3643b4b8 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:57.369239 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7670f073-fa88-4072-a617-b92a3643b4b8 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:57.369681 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7670f073-fa88-4072-a617-b92a3643b4b8 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:57.370412 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7670f073-fa88-4072-a617-b92a3643b4b8 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:57.370898 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7670f073-fa88-4072-a617-b92a3643b4b8 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:57.372334 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-7c343ee0-1d36-41ce-a88a-6c01efde8df1 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:57.372949 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-7c343ee0-1d36-41ce-a88a-6c01efde8df1 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:57.373844 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-7c343ee0-1d36-41ce-a88a-6c01efde8df1 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:57.374460 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-7c343ee0-1d36-41ce-a88a-6c01efde8df1 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:57.375085 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-7c343ee0-1d36-41ce-a88a-6c01efde8df1 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:57.376724 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7670f073-fa88-4072-a617-b92a3643b4b8 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:57.419316 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-7670f073-fa88-4072-a617-b92a3643b4b8 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: cc41312a-3de8-4584-9bcf-a1f31b952025] Going to try to terminate instance {{(pid=127198) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 16:36:57.425436 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:36:57.441569 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-7c343ee0-1d36-41ce-a88a-6c01efde8df1 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] 10.222.0.23 "GET /compute/v2.1/servers/11fefdc7-238f-4580-96f8-d4ba861abeea/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.309311 Sep 09 16:36:57.443055 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 330/660] 10.222.0.23 () {58 vars in 1302 bytes} [Fri Sep 9 16:36:57 2022] GET /compute/v2.1/servers/11fefdc7-238f-4580-96f8-d4ba861abeea/os-volume_attachments => generated 25 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 09 16:36:57.552631 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-33dbf318-367a-4e01-8e81-e7b7695bfd15 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:36:57.555301 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-7670f073-fa88-4072-a617-b92a3643b4b8 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "DELETE /compute/v2.1/servers/cc41312a-3de8-4584-9bcf-a1f31b952025" status: 204 len: 0 microversion: 2.1 time: 0.225020 Sep 09 16:36:57.555950 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 331/661] 10.222.0.23 () {58 vars in 1239 bytes} [Fri Sep 9 16:36:57 2022] DELETE /compute/v2.1/servers/cc41312a-3de8-4584-9bcf-a1f31b952025 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 16:36:57.561642 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-33dbf318-367a-4e01-8e81-e7b7695bfd15 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] [instance: 11fefdc7-238f-4580-96f8-d4ba861abeea] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:36:57.573178 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-33dbf318-367a-4e01-8e81-e7b7695bfd15 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:57.573398 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-2d7630b8-2d41-4d6e-92a0-a5d7a972e649 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:36:57.574170 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-33dbf318-367a-4e01-8e81-e7b7695bfd15 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:57.574674 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-2d7630b8-2d41-4d6e-92a0-a5d7a972e649 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: cc41312a-3de8-4584-9bcf-a1f31b952025] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:36:57.574954 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-33dbf318-367a-4e01-8e81-e7b7695bfd15 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:57.575819 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-33dbf318-367a-4e01-8e81-e7b7695bfd15 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:57.576613 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-33dbf318-367a-4e01-8e81-e7b7695bfd15 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:57.577339 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-33dbf318-367a-4e01-8e81-e7b7695bfd15 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:57.582350 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2d7630b8-2d41-4d6e-92a0-a5d7a972e649 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:57.582953 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2d7630b8-2d41-4d6e-92a0-a5d7a972e649 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:57.583549 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2d7630b8-2d41-4d6e-92a0-a5d7a972e649 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:57.584418 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2d7630b8-2d41-4d6e-92a0-a5d7a972e649 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:57.585035 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2d7630b8-2d41-4d6e-92a0-a5d7a972e649 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:57.586133 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2d7630b8-2d41-4d6e-92a0-a5d7a972e649 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:57.605493 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-33dbf318-367a-4e01-8e81-e7b7695bfd15 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] [instance: 11fefdc7-238f-4580-96f8-d4ba861abeea] Going to try to terminate instance {{(pid=127196) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 16:36:57.691182 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-33dbf318-367a-4e01-8e81-e7b7695bfd15 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] 10.222.0.23 "DELETE /compute/v2.1/servers/11fefdc7-238f-4580-96f8-d4ba861abeea" status: 204 len: 0 microversion: 2.1 time: 0.142256 Sep 09 16:36:57.692056 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 331/662] 10.222.0.23 () {58 vars in 1239 bytes} [Fri Sep 9 16:36:57 2022] DELETE /compute/v2.1/servers/11fefdc7-238f-4580-96f8-d4ba861abeea => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 16:36:57.701124 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-d1adb349-fa04-4098-9b5f-d7af7273d0a3 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:36:57.702028 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-d1adb349-fa04-4098-9b5f-d7af7273d0a3 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] [instance: 11fefdc7-238f-4580-96f8-d4ba861abeea] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:36:57.708300 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-d1adb349-fa04-4098-9b5f-d7af7273d0a3 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:57.708810 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-d1adb349-fa04-4098-9b5f-d7af7273d0a3 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:57.709256 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-d1adb349-fa04-4098-9b5f-d7af7273d0a3 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:57.709943 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-d1adb349-fa04-4098-9b5f-d7af7273d0a3 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:57.710394 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-d1adb349-fa04-4098-9b5f-d7af7273d0a3 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:57.710864 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-d1adb349-fa04-4098-9b5f-d7af7273d0a3 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:57.730527 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-2d7630b8-2d41-4d6e-92a0-a5d7a972e649 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d86f09c6304121be2021cb5c15e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ab544d0b547919794e3efb49ba0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:36:57.741372 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-2d7630b8-2d41-4d6e-92a0-a5d7a972e649 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/cc41312a-3de8-4584-9bcf-a1f31b952025" status: 200 len: 1522 microversion: 2.1 time: 0.180129 Sep 09 16:36:57.742158 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 332/663] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:36:57 2022] GET /compute/v2.1/servers/cc41312a-3de8-4584-9bcf-a1f31b952025 => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:36:57.776071 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-17fb9c5c-21ed-44f9-9f1c-a4b86936c1d2 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:36:57.777488 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-17fb9c5c-21ed-44f9-9f1c-a4b86936c1d2 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: 27b503a6-c023-49fb-b11a-37da810939cf] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:36:57.783441 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-17fb9c5c-21ed-44f9-9f1c-a4b86936c1d2 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:57.784099 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-17fb9c5c-21ed-44f9-9f1c-a4b86936c1d2 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:57.784681 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-17fb9c5c-21ed-44f9-9f1c-a4b86936c1d2 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:57.785365 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-17fb9c5c-21ed-44f9-9f1c-a4b86936c1d2 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:57.785950 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-17fb9c5c-21ed-44f9-9f1c-a4b86936c1d2 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:57.786695 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-17fb9c5c-21ed-44f9-9f1c-a4b86936c1d2 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:57.819182 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-17fb9c5c-21ed-44f9-9f1c-a4b86936c1d2 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:57.819658 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-17fb9c5c-21ed-44f9-9f1c-a4b86936c1d2 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:57.820082 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-17fb9c5c-21ed-44f9-9f1c-a4b86936c1d2 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:57.820521 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.objects.instance [None req-17fb9c5c-21ed-44f9-9f1c-a4b86936c1d2 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lazy-loading 'fault' on Instance uuid 27b503a6-c023-49fb-b11a-37da810939cf {{(pid=127198) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 16:36:57.868803 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-17fb9c5c-21ed-44f9-9f1c-a4b86936c1d2 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:36:57.873045 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-d1adb349-fa04-4098-9b5f-d7af7273d0a3 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c0721dc18343b18993ff5af098841d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17967a941be4a04bbc180e2cf3a7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:36:57.877438 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-17fb9c5c-21ed-44f9-9f1c-a4b86936c1d2 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:36:57.879036 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-17fb9c5c-21ed-44f9-9f1c-a4b86936c1d2 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:36:57.880336 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-17fb9c5c-21ed-44f9-9f1c-a4b86936c1d2 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf" status: 200 len: 1371 microversion: 2.20 time: 0.108369 Sep 09 16:36:57.880900 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 333/664] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Sep 9 16:36:57 2022] GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf => generated 1371 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 16:36:57.882220 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-d1adb349-fa04-4098-9b5f-d7af7273d0a3 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] 10.222.0.23 "GET /compute/v2.1/servers/11fefdc7-238f-4580-96f8-d4ba861abeea" status: 200 len: 1682 microversion: 2.1 time: 0.184981 Sep 09 16:36:57.891375 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 332/665] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:36:57 2022] GET /compute/v2.1/servers/11fefdc7-238f-4580-96f8-d4ba861abeea => generated 1682 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:36:58.768948 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-a8488120-64b0-4452-9818-8893e66ca09d tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:36:58.769985 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-a8488120-64b0-4452-9818-8893e66ca09d tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: cc41312a-3de8-4584-9bcf-a1f31b952025] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:36:58.780857 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a8488120-64b0-4452-9818-8893e66ca09d tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:58.781645 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a8488120-64b0-4452-9818-8893e66ca09d tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:58.782355 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a8488120-64b0-4452-9818-8893e66ca09d tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:58.783541 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a8488120-64b0-4452-9818-8893e66ca09d tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:58.784285 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a8488120-64b0-4452-9818-8893e66ca09d tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:58.784977 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a8488120-64b0-4452-9818-8893e66ca09d tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:58.905709 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-471a5455-e201-4616-9e0b-c0b50d29ae32 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:36:58.906285 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-471a5455-e201-4616-9e0b-c0b50d29ae32 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] [instance: 11fefdc7-238f-4580-96f8-d4ba861abeea] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:36:58.913492 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-471a5455-e201-4616-9e0b-c0b50d29ae32 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:58.914034 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-471a5455-e201-4616-9e0b-c0b50d29ae32 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:58.914531 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-471a5455-e201-4616-9e0b-c0b50d29ae32 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:58.915362 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-471a5455-e201-4616-9e0b-c0b50d29ae32 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:58.915882 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-471a5455-e201-4616-9e0b-c0b50d29ae32 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:58.916703 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-471a5455-e201-4616-9e0b-c0b50d29ae32 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:58.928851 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-a8488120-64b0-4452-9818-8893e66ca09d tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d86f09c6304121be2021cb5c15e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ab544d0b547919794e3efb49ba0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:36:58.936857 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-a8488120-64b0-4452-9818-8893e66ca09d tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/cc41312a-3de8-4584-9bcf-a1f31b952025" status: 200 len: 1522 microversion: 2.1 time: 0.174456 Sep 09 16:36:58.937516 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 334/666] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:36:58 2022] GET /compute/v2.1/servers/cc41312a-3de8-4584-9bcf-a1f31b952025 => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:36:58.942294 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-5ecdeba4-153f-4ce6-ac72-96c54be076aa tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:36:58.942923 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-5ecdeba4-153f-4ce6-ac72-96c54be076aa tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: 27b503a6-c023-49fb-b11a-37da810939cf] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:36:58.948636 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5ecdeba4-153f-4ce6-ac72-96c54be076aa tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:58.949475 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5ecdeba4-153f-4ce6-ac72-96c54be076aa tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:58.949915 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5ecdeba4-153f-4ce6-ac72-96c54be076aa tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:58.950622 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5ecdeba4-153f-4ce6-ac72-96c54be076aa tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:58.951074 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5ecdeba4-153f-4ce6-ac72-96c54be076aa tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:58.951491 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5ecdeba4-153f-4ce6-ac72-96c54be076aa tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:58.982375 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5ecdeba4-153f-4ce6-ac72-96c54be076aa tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:36:58.982891 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5ecdeba4-153f-4ce6-ac72-96c54be076aa tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:36:58.983316 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5ecdeba4-153f-4ce6-ac72-96c54be076aa tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:36:58.983754 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.objects.instance [None req-5ecdeba4-153f-4ce6-ac72-96c54be076aa tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lazy-loading 'fault' on Instance uuid 27b503a6-c023-49fb-b11a-37da810939cf {{(pid=127198) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 16:36:59.037481 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-5ecdeba4-153f-4ce6-ac72-96c54be076aa tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:36:59.046323 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-5ecdeba4-153f-4ce6-ac72-96c54be076aa tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:36:59.047815 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-5ecdeba4-153f-4ce6-ac72-96c54be076aa tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:36:59.048973 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-5ecdeba4-153f-4ce6-ac72-96c54be076aa tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf" status: 200 len: 1371 microversion: 2.20 time: 0.110426 Sep 09 16:36:59.049777 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 335/667] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Sep 9 16:36:58 2022] GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf => generated 1371 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 16:36:59.069425 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-471a5455-e201-4616-9e0b-c0b50d29ae32 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c0721dc18343b18993ff5af098841d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17967a941be4a04bbc180e2cf3a7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:36:59.077726 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-471a5455-e201-4616-9e0b-c0b50d29ae32 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] 10.222.0.23 "GET /compute/v2.1/servers/11fefdc7-238f-4580-96f8-d4ba861abeea" status: 200 len: 1682 microversion: 2.1 time: 0.175972 Sep 09 16:36:59.078302 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 333/668] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:36:58 2022] GET /compute/v2.1/servers/11fefdc7-238f-4580-96f8-d4ba861abeea => generated 1682 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:37:00.018616 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-3c2aaa72-c00a-49c0-a653-d5a28090c452 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:37:00.019245 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-3c2aaa72-c00a-49c0-a653-d5a28090c452 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: cc41312a-3de8-4584-9bcf-a1f31b952025] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:37:00.025331 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3c2aaa72-c00a-49c0-a653-d5a28090c452 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:37:00.025816 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3c2aaa72-c00a-49c0-a653-d5a28090c452 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:37:00.026249 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3c2aaa72-c00a-49c0-a653-d5a28090c452 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:37:00.026972 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3c2aaa72-c00a-49c0-a653-d5a28090c452 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:37:00.027426 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3c2aaa72-c00a-49c0-a653-d5a28090c452 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:37:00.027849 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3c2aaa72-c00a-49c0-a653-d5a28090c452 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:37:00.074152 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-d85fd2b2-56fb-4231-97c7-04b8fa09adab tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:37:00.074864 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-d85fd2b2-56fb-4231-97c7-04b8fa09adab tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: 27b503a6-c023-49fb-b11a-37da810939cf] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:37:00.081822 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-d85fd2b2-56fb-4231-97c7-04b8fa09adab tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:37:00.082299 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-d85fd2b2-56fb-4231-97c7-04b8fa09adab tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:37:00.082764 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-d85fd2b2-56fb-4231-97c7-04b8fa09adab tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:37:00.083564 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-d85fd2b2-56fb-4231-97c7-04b8fa09adab tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:37:00.084212 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-d85fd2b2-56fb-4231-97c7-04b8fa09adab tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:37:00.084632 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-d85fd2b2-56fb-4231-97c7-04b8fa09adab tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:37:00.115862 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-d85fd2b2-56fb-4231-97c7-04b8fa09adab tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:37:00.116338 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-d85fd2b2-56fb-4231-97c7-04b8fa09adab tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:37:00.116761 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-d85fd2b2-56fb-4231-97c7-04b8fa09adab tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:37:00.117201 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.objects.instance [None req-d85fd2b2-56fb-4231-97c7-04b8fa09adab tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lazy-loading 'fault' on Instance uuid 27b503a6-c023-49fb-b11a-37da810939cf {{(pid=127196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 16:37:00.163586 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-d85fd2b2-56fb-4231-97c7-04b8fa09adab tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:37:00.172200 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-d85fd2b2-56fb-4231-97c7-04b8fa09adab tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:37:00.173667 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-d85fd2b2-56fb-4231-97c7-04b8fa09adab tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:37:00.175099 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-d85fd2b2-56fb-4231-97c7-04b8fa09adab tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf" status: 200 len: 1371 microversion: 2.20 time: 0.104865 Sep 09 16:37:00.175654 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 334/669] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Sep 9 16:37:00 2022] GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf => generated 1371 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 16:37:00.180485 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-4275bbab-4fc1-4009-8fb9-833dcedb2e5c tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:37:00.180855 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-4275bbab-4fc1-4009-8fb9-833dcedb2e5c tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] [instance: 11fefdc7-238f-4580-96f8-d4ba861abeea] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:37:00.186768 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-4275bbab-4fc1-4009-8fb9-833dcedb2e5c tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:37:00.187248 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-4275bbab-4fc1-4009-8fb9-833dcedb2e5c tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:37:00.187673 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-4275bbab-4fc1-4009-8fb9-833dcedb2e5c tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:37:00.188357 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-4275bbab-4fc1-4009-8fb9-833dcedb2e5c tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:37:00.188802 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-4275bbab-4fc1-4009-8fb9-833dcedb2e5c tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:37:00.189215 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-4275bbab-4fc1-4009-8fb9-833dcedb2e5c tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:37:00.189719 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-3c2aaa72-c00a-49c0-a653-d5a28090c452 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d86f09c6304121be2021cb5c15e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ab544d0b547919794e3efb49ba0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:37:00.199941 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-3c2aaa72-c00a-49c0-a653-d5a28090c452 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/cc41312a-3de8-4584-9bcf-a1f31b952025" status: 200 len: 1522 microversion: 2.1 time: 0.242750 Sep 09 16:37:00.200636 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 336/670] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:36:59 2022] GET /compute/v2.1/servers/cc41312a-3de8-4584-9bcf-a1f31b952025 => generated 1522 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:37:00.204308 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG dbcounter [-] [127196] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:37:00.319446 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-4275bbab-4fc1-4009-8fb9-833dcedb2e5c tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c0721dc18343b18993ff5af098841d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17967a941be4a04bbc180e2cf3a7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:37:00.327583 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-4275bbab-4fc1-4009-8fb9-833dcedb2e5c tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] 10.222.0.23 "GET /compute/v2.1/servers/11fefdc7-238f-4580-96f8-d4ba861abeea" status: 200 len: 1682 microversion: 2.1 time: 0.150987 Sep 09 16:37:00.328150 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 335/671] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:37:00 2022] GET /compute/v2.1/servers/11fefdc7-238f-4580-96f8-d4ba861abeea => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:37:01.208765 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-d5fee37a-7d09-4c48-ae8d-0abe1aa49cbe tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:37:01.209308 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-d5fee37a-7d09-4c48-ae8d-0abe1aa49cbe tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: 27b503a6-c023-49fb-b11a-37da810939cf] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:37:01.216160 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d5fee37a-7d09-4c48-ae8d-0abe1aa49cbe tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:37:01.216637 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d5fee37a-7d09-4c48-ae8d-0abe1aa49cbe tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:37:01.217062 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d5fee37a-7d09-4c48-ae8d-0abe1aa49cbe tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:37:01.217741 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d5fee37a-7d09-4c48-ae8d-0abe1aa49cbe tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:37:01.218189 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d5fee37a-7d09-4c48-ae8d-0abe1aa49cbe tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:37:01.218639 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d5fee37a-7d09-4c48-ae8d-0abe1aa49cbe tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:37:01.222893 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-d7009caf-211a-4299-85ae-fa5860949c30 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:37:01.223518 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-d7009caf-211a-4299-85ae-fa5860949c30 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: cc41312a-3de8-4584-9bcf-a1f31b952025] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:37:01.230680 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-d7009caf-211a-4299-85ae-fa5860949c30 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:37:01.231160 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-d7009caf-211a-4299-85ae-fa5860949c30 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:37:01.231583 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-d7009caf-211a-4299-85ae-fa5860949c30 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:37:01.232280 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-d7009caf-211a-4299-85ae-fa5860949c30 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:37:01.232709 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-d7009caf-211a-4299-85ae-fa5860949c30 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:37:01.233124 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-d7009caf-211a-4299-85ae-fa5860949c30 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:37:01.252200 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d5fee37a-7d09-4c48-ae8d-0abe1aa49cbe tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:37:01.252676 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d5fee37a-7d09-4c48-ae8d-0abe1aa49cbe tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:37:01.253101 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d5fee37a-7d09-4c48-ae8d-0abe1aa49cbe tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:37:01.253535 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.objects.instance [None req-d5fee37a-7d09-4c48-ae8d-0abe1aa49cbe tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lazy-loading 'fault' on Instance uuid 27b503a6-c023-49fb-b11a-37da810939cf {{(pid=127198) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 16:37:01.305111 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-d5fee37a-7d09-4c48-ae8d-0abe1aa49cbe tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:37:01.313601 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-d5fee37a-7d09-4c48-ae8d-0abe1aa49cbe tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:37:01.315074 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-d5fee37a-7d09-4c48-ae8d-0abe1aa49cbe tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:37:01.316263 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-d5fee37a-7d09-4c48-ae8d-0abe1aa49cbe tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf" status: 200 len: 1371 microversion: 2.20 time: 0.114171 Sep 09 16:37:01.316830 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 337/672] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Sep 9 16:37:01 2022] GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf => generated 1371 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 16:37:01.352010 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-1011ecfc-8436-48f5-b218-1dedba034c7e tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:37:01.352660 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-1011ecfc-8436-48f5-b218-1dedba034c7e tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] [instance: 11fefdc7-238f-4580-96f8-d4ba861abeea] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:37:01.359007 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1011ecfc-8436-48f5-b218-1dedba034c7e tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:37:01.359499 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1011ecfc-8436-48f5-b218-1dedba034c7e tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:37:01.359933 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1011ecfc-8436-48f5-b218-1dedba034c7e tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:37:01.360629 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1011ecfc-8436-48f5-b218-1dedba034c7e tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:37:01.361081 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1011ecfc-8436-48f5-b218-1dedba034c7e tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:37:01.361513 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1011ecfc-8436-48f5-b218-1dedba034c7e tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:37:01.392382 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-d7009caf-211a-4299-85ae-fa5860949c30 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d86f09c6304121be2021cb5c15e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ab544d0b547919794e3efb49ba0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:37:01.400350 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-d7009caf-211a-4299-85ae-fa5860949c30 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/cc41312a-3de8-4584-9bcf-a1f31b952025" status: 200 len: 1522 microversion: 2.1 time: 0.181458 Sep 09 16:37:01.400979 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 336/673] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:37:01 2022] GET /compute/v2.1/servers/cc41312a-3de8-4584-9bcf-a1f31b952025 => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:37:01.490391 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-1011ecfc-8436-48f5-b218-1dedba034c7e tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c0721dc18343b18993ff5af098841d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17967a941be4a04bbc180e2cf3a7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:37:01.498542 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-1011ecfc-8436-48f5-b218-1dedba034c7e tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] 10.222.0.23 "GET /compute/v2.1/servers/11fefdc7-238f-4580-96f8-d4ba861abeea" status: 200 len: 1682 microversion: 2.1 time: 0.150458 Sep 09 16:37:01.499106 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 338/674] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:37:01 2022] GET /compute/v2.1/servers/11fefdc7-238f-4580-96f8-d4ba861abeea => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:37:02.346372 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-28a59ad6-b0d4-4503-9c77-c5a936f7f15b tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:37:02.347477 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-28a59ad6-b0d4-4503-9c77-c5a936f7f15b tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: 27b503a6-c023-49fb-b11a-37da810939cf] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:37:02.354845 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-28a59ad6-b0d4-4503-9c77-c5a936f7f15b tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:37:02.355315 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-28a59ad6-b0d4-4503-9c77-c5a936f7f15b tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:37:02.355748 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-28a59ad6-b0d4-4503-9c77-c5a936f7f15b tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:37:02.356434 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-28a59ad6-b0d4-4503-9c77-c5a936f7f15b tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:37:02.356881 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-28a59ad6-b0d4-4503-9c77-c5a936f7f15b tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:37:02.357295 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-28a59ad6-b0d4-4503-9c77-c5a936f7f15b tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:37:02.389927 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-28a59ad6-b0d4-4503-9c77-c5a936f7f15b tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:37:02.390386 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-28a59ad6-b0d4-4503-9c77-c5a936f7f15b tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:37:02.390833 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-28a59ad6-b0d4-4503-9c77-c5a936f7f15b tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:37:02.391267 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.objects.instance [None req-28a59ad6-b0d4-4503-9c77-c5a936f7f15b tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lazy-loading 'fault' on Instance uuid 27b503a6-c023-49fb-b11a-37da810939cf {{(pid=127196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 16:37:02.423821 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-d7db33d0-127c-4eb0-a19c-dbcc6b5c69ab tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:37:02.424415 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-d7db33d0-127c-4eb0-a19c-dbcc6b5c69ab tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: cc41312a-3de8-4584-9bcf-a1f31b952025] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:37:02.431011 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d7db33d0-127c-4eb0-a19c-dbcc6b5c69ab tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:37:02.431508 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d7db33d0-127c-4eb0-a19c-dbcc6b5c69ab tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:37:02.431922 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d7db33d0-127c-4eb0-a19c-dbcc6b5c69ab tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:37:02.432580 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-28a59ad6-b0d4-4503-9c77-c5a936f7f15b tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:37:02.432720 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d7db33d0-127c-4eb0-a19c-dbcc6b5c69ab tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:37:02.433037 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d7db33d0-127c-4eb0-a19c-dbcc6b5c69ab tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:37:02.433469 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d7db33d0-127c-4eb0-a19c-dbcc6b5c69ab tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:37:02.441017 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-28a59ad6-b0d4-4503-9c77-c5a936f7f15b tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:37:02.442468 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-28a59ad6-b0d4-4503-9c77-c5a936f7f15b tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:37:02.443754 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-28a59ad6-b0d4-4503-9c77-c5a936f7f15b tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf" status: 200 len: 1371 microversion: 2.20 time: 0.104164 Sep 09 16:37:02.444311 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 337/675] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Sep 9 16:37:02 2022] GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf => generated 1371 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 16:37:02.521306 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-ef414e8e-26a1-49e5-924c-fcb3734b23f2 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:37:02.522014 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-ef414e8e-26a1-49e5-924c-fcb3734b23f2 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] [instance: 11fefdc7-238f-4580-96f8-d4ba861abeea] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:37:02.528598 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-ef414e8e-26a1-49e5-924c-fcb3734b23f2 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:37:02.529169 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-ef414e8e-26a1-49e5-924c-fcb3734b23f2 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:37:02.529667 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-ef414e8e-26a1-49e5-924c-fcb3734b23f2 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:37:02.530415 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-ef414e8e-26a1-49e5-924c-fcb3734b23f2 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:37:02.530909 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-ef414e8e-26a1-49e5-924c-fcb3734b23f2 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:37:02.531334 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-ef414e8e-26a1-49e5-924c-fcb3734b23f2 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:37:02.564840 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-d7db33d0-127c-4eb0-a19c-dbcc6b5c69ab tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d86f09c6304121be2021cb5c15e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ab544d0b547919794e3efb49ba0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:37:02.573218 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-d7db33d0-127c-4eb0-a19c-dbcc6b5c69ab tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/cc41312a-3de8-4584-9bcf-a1f31b952025" status: 200 len: 1522 microversion: 2.1 time: 0.153261 Sep 09 16:37:02.573786 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 339/676] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:37:02 2022] GET /compute/v2.1/servers/cc41312a-3de8-4584-9bcf-a1f31b952025 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 16:37:02.658803 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-ef414e8e-26a1-49e5-924c-fcb3734b23f2 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c0721dc18343b18993ff5af098841d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17967a941be4a04bbc180e2cf3a7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:37:02.666956 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-ef414e8e-26a1-49e5-924c-fcb3734b23f2 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] 10.222.0.23 "GET /compute/v2.1/servers/11fefdc7-238f-4580-96f8-d4ba861abeea" status: 200 len: 1682 microversion: 2.1 time: 0.149199 Sep 09 16:37:02.667500 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 338/677] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:37:02 2022] GET /compute/v2.1/servers/11fefdc7-238f-4580-96f8-d4ba861abeea => generated 1682 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:37:03.468962 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-a4d0b378-9e3c-4cc3-b381-861a584b5e95 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:37:03.469551 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-a4d0b378-9e3c-4cc3-b381-861a584b5e95 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: 27b503a6-c023-49fb-b11a-37da810939cf] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:37:03.476501 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a4d0b378-9e3c-4cc3-b381-861a584b5e95 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:37:03.477264 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a4d0b378-9e3c-4cc3-b381-861a584b5e95 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:37:03.477844 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a4d0b378-9e3c-4cc3-b381-861a584b5e95 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:37:03.478712 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a4d0b378-9e3c-4cc3-b381-861a584b5e95 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:37:03.479399 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a4d0b378-9e3c-4cc3-b381-861a584b5e95 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:37:03.479964 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a4d0b378-9e3c-4cc3-b381-861a584b5e95 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:37:03.501714 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.wsgi [None req-a4d0b378-9e3c-4cc3-b381-861a584b5e95 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] HTTP exception thrown: Instance 27b503a6-c023-49fb-b11a-37da810939cf could not be found. Sep 09 16:37:03.503554 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-a4d0b378-9e3c-4cc3-b381-861a584b5e95 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Request method failure captured: Sep 09 16:37:03.503554 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: request: GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf HTTP/1.1 Sep 09 16:37:03.503554 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Accept: application/json Sep 09 16:37:03.503554 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Accept-Encoding: identity Sep 09 16:37:03.503554 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Connection: close Sep 09 16:37:03.503554 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Content-Length: 0 Sep 09 16:37:03.503554 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Content-Type: application/json Sep 09 16:37:03.503554 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Host: 10.222.0.23 Sep 09 16:37:03.503554 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Openstack-System-Scope: None Sep 09 16:37:03.503554 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: User-Agent: python-urllib3/1.26.12 Sep 09 16:37:03.503554 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Auth-Token: gAAAAABjG2raKYeiSpbkPQNbV7fWt1cZR_8Twt55ecqE0w84KGgvpJskbtFih0XPKN4NfFMBp4ICDdrG6hYAZbjgPreFya4ru2WM3cAXbDaI2xKcVwIS7rE8NZFGdJ2dTo6h1U2haccU7HXgJ_zTmaKPUi9_WJQQdTThBPEpEt3WrJzqpXhxNbs Sep 09 16:37:03.503554 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Domain-Id: None Sep 09 16:37:03.503554 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Domain-Name: None Sep 09 16:37:03.503554 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Identity-Status: Confirmed Sep 09 16:37:03.503554 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Is-Admin-Project: True Sep 09 16:37:03.503554 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Openstack-Nova-Api-Version: 2.20 Sep 09 16:37:03.503554 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Project-Domain-Id: default Sep 09 16:37:03.503554 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Project-Domain-Name: Default Sep 09 16:37:03.503554 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Project-Id: 3fca9208950f4d1a92bd52b4e5f5b2a1 Sep 09 16:37:03.503554 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1737157302 Sep 09 16:37:03.503554 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Role: member,reader Sep 09 16:37:03.503554 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Roles: member,reader Sep 09 16:37:03.504973 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3fca9208950f4d1a92bd52b4e5f5b2a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3fca9208950f4d1a92bd52b4e5f5b2a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3fca9208950f4d1a92bd52b4e5f5b2a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3fca9208950f4d1a92bd52b4e5f5b2a1"}]}] Sep 09 16:37:03.504973 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1737157302 Sep 09 16:37:03.504973 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Tenant-Id: 3fca9208950f4d1a92bd52b4e5f5b2a1 Sep 09 16:37:03.504973 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1737157302 Sep 09 16:37:03.504973 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User: tempest-AttachVolumeShelveTestJSON-1737157302-project Sep 09 16:37:03.504973 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User-Domain-Id: default Sep 09 16:37:03.504973 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User-Domain-Name: Default Sep 09 16:37:03.504973 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User-Id: f8bd900e231242c3ae67432d26d089da Sep 09 16:37:03.504973 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1737157302-project Sep 09 16:37:03.504973 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: method: > Sep 09 16:37:03.504973 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: exception: Instance 27b503a6-c023-49fb-b11a-37da810939cf could not be found. Sep 09 16:37:03.504973 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: action_args: {'id': '27b503a6-c023-49fb-b11a-37da810939cf'} Sep 09 16:37:03.505735 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 16:37:03.505735 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:37:03.505735 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 16:37:03.505735 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 16:37:03.505735 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 16:37:03.505735 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 16:37:03.505735 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 16:37:03.505735 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 16:37:03.505735 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 16:37:03.505735 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 16:37:03.505735 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27b503a6-c023-49fb-b11a-37da810939cf could not be found. Sep 09 16:37:03.505735 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:37:03.505735 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 16:37:03.505735 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:37:03.505735 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:37:03.505735 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 16:37:03.505735 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 16:37:03.505735 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 16:37:03.505735 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 16:37:03.505735 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 16:37:03.506894 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 16:37:03.506894 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 16:37:03.506894 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 16:37:03.506894 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 16:37:03.506894 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 16:37:03.506894 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 16:37:03.506894 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 16:37:03.506894 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27b503a6-c023-49fb-b11a-37da810939cf could not be found. Sep 09 16:37:03.506894 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:37:03.506894 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 16:37:03.506894 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:37:03.506894 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:37:03.506894 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 16:37:03.506894 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 16:37:03.506894 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 16:37:03.506894 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 16:37:03.506894 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27b503a6-c023-49fb-b11a-37da810939cf could not be found. Sep 09 16:37:03.506894 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:37:03.507941 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-a4d0b378-9e3c-4cc3-b381-861a584b5e95 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Returning 404 to user: Instance 27b503a6-c023-49fb-b11a-37da810939cf could not be found. {{(pid=127198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 16:37:03.507941 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-a4d0b378-9e3c-4cc3-b381-861a584b5e95 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf" status: 404 len: 111 microversion: 2.20 time: 0.039941 Sep 09 16:37:03.507941 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 340/678] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Sep 9 16:37:03 2022] GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 09 16:37:03.514378 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-d2f4413d-b3f6-4900-94ec-63d4e479cc07 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '.version_select at 0x7f24fb750790>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:37:03.536903 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-d2f4413d-b3f6-4900-94ec-63d4e479cc07 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1808603169" status: 204 len: 0 microversion: 2.20 time: 0.026658 Sep 09 16:37:03.537524 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 339/679] 10.222.0.23 () {60 vars in 1262 bytes} [Fri Sep 9 16:37:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1808603169 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 09 16:37:03.574803 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [req-6e81e843-e34f-4818-82d6-237f39c60e63 req-47df8752-0ff6-4311-9550-17aeec07b003 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc41312a-3de8-4584-9bcf-a1f31b952025", "name": "network-vif-deleted", "tag": "fe97fa1b-e830-46b1-ba10-d58f1d1269f2"}]} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:37:03.585750 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-6e81e843-e34f-4818-82d6-237f39c60e63 req-47df8752-0ff6-4311-9550-17aeec07b003 service nova] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:37:03.586381 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-6e81e843-e34f-4818-82d6-237f39c60e63 req-47df8752-0ff6-4311-9550-17aeec07b003 service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:37:03.586927 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-6e81e843-e34f-4818-82d6-237f39c60e63 req-47df8752-0ff6-4311-9550-17aeec07b003 service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:37:03.598535 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-a3efb6ca-22c2-4d9e-a482-e95c5b5bbac7 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:37:03.599436 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-a3efb6ca-22c2-4d9e-a482-e95c5b5bbac7 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: cc41312a-3de8-4584-9bcf-a1f31b952025] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:37:03.608109 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-a3efb6ca-22c2-4d9e-a482-e95c5b5bbac7 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:37:03.608512 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-a3efb6ca-22c2-4d9e-a482-e95c5b5bbac7 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:37:03.608950 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-a3efb6ca-22c2-4d9e-a482-e95c5b5bbac7 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:37:03.609654 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-a3efb6ca-22c2-4d9e-a482-e95c5b5bbac7 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:37:03.610110 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-a3efb6ca-22c2-4d9e-a482-e95c5b5bbac7 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:37:03.610548 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-a3efb6ca-22c2-4d9e-a482-e95c5b5bbac7 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:37:03.623754 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.compute.server_external_events [req-6e81e843-e34f-4818-82d6-237f39c60e63 req-47df8752-0ff6-4311-9550-17aeec07b003 service nova] Creating event network-vif-deleted:fe97fa1b-e830-46b1-ba10-d58f1d1269f2 for instance cc41312a-3de8-4584-9bcf-a1f31b952025 on hv-cinder-83124 Sep 09 16:37:03.637264 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [req-6e81e843-e34f-4818-82d6-237f39c60e63 req-47df8752-0ff6-4311-9550-17aeec07b003 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067971 Sep 09 16:37:03.638241 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 341/680] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Sep 9 16:37:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:37:03.692854 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-03ff04e5-a14e-4f10-adc4-c9d400bb0deb tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:37:03.693622 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-03ff04e5-a14e-4f10-adc4-c9d400bb0deb tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] [instance: 11fefdc7-238f-4580-96f8-d4ba861abeea] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:37:03.700419 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-03ff04e5-a14e-4f10-adc4-c9d400bb0deb tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:37:03.700901 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-03ff04e5-a14e-4f10-adc4-c9d400bb0deb tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:37:03.701506 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-03ff04e5-a14e-4f10-adc4-c9d400bb0deb tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:37:03.702225 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-03ff04e5-a14e-4f10-adc4-c9d400bb0deb tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:37:03.702782 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-03ff04e5-a14e-4f10-adc4-c9d400bb0deb tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:37:03.703391 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-03ff04e5-a14e-4f10-adc4-c9d400bb0deb tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:37:03.727653 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-a3efb6ca-22c2-4d9e-a482-e95c5b5bbac7 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d86f09c6304121be2021cb5c15e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ab544d0b547919794e3efb49ba0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:37:03.741612 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-a3efb6ca-22c2-4d9e-a482-e95c5b5bbac7 tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/cc41312a-3de8-4584-9bcf-a1f31b952025" status: 200 len: 1307 microversion: 2.1 time: 0.149230 Sep 09 16:37:03.757075 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 340/681] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:37:03 2022] GET /compute/v2.1/servers/cc41312a-3de8-4584-9bcf-a1f31b952025 => generated 1307 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 16:37:03.781289 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-03ff04e5-a14e-4f10-adc4-c9d400bb0deb tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c0721dc18343b18993ff5af098841d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17967a941be4a04bbc180e2cf3a7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:37:03.789896 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-03ff04e5-a14e-4f10-adc4-c9d400bb0deb tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] 10.222.0.23 "GET /compute/v2.1/servers/11fefdc7-238f-4580-96f8-d4ba861abeea" status: 200 len: 1614 microversion: 2.1 time: 0.102353 Sep 09 16:37:03.798773 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 342/682] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:37:03 2022] GET /compute/v2.1/servers/11fefdc7-238f-4580-96f8-d4ba861abeea => generated 1614 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:37:04.008624 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [req-3507130f-a330-4bd4-9254-8411cda13d8e req-75f3b984-205a-4bc3-9ef2-378e68487056 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11fefdc7-238f-4580-96f8-d4ba861abeea", "name": "network-vif-deleted", "tag": "c4a63018-5377-450a-9b13-cab181f1fd22"}]} {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:37:04.019625 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [req-3507130f-a330-4bd4-9254-8411cda13d8e req-75f3b984-205a-4bc3-9ef2-378e68487056 service nova] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:37:04.020101 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [req-3507130f-a330-4bd4-9254-8411cda13d8e req-75f3b984-205a-4bc3-9ef2-378e68487056 service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:37:04.020724 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [req-3507130f-a330-4bd4-9254-8411cda13d8e req-75f3b984-205a-4bc3-9ef2-378e68487056 service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:37:04.038532 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.compute.server_external_events [req-3507130f-a330-4bd4-9254-8411cda13d8e req-75f3b984-205a-4bc3-9ef2-378e68487056 service nova] Creating event network-vif-deleted:c4a63018-5377-450a-9b13-cab181f1fd22 for instance 11fefdc7-238f-4580-96f8-d4ba861abeea on hv-cinder-83124 Sep 09 16:37:04.045293 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [req-3507130f-a330-4bd4-9254-8411cda13d8e req-75f3b984-205a-4bc3-9ef2-378e68487056 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040441 Sep 09 16:37:04.050412 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 341/683] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Sep 9 16:37:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:37:04.660657 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-65a8b112-b16a-45b2-ac22-dce36bf0b087 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Action: 'create', calling method: .version_select at 0x7f24fb5580d0>, body: {"keypair": {"name": "tempest-keypair-766971705", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBABFLhLvFXdg6kMPop+/Ht7mN+0+gNeXNq6KlTxN9W8G7zOVmP8iiZmpdXXeJKFMGPxXMhIePR+Syial1j/UHbujHAP8zBDvFvnbrGkK5OPgefWCmhPnxzGrTPphBeq0ag=="}} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:37:04.677776 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.quota [None req-65a8b112-b16a-45b2-ac22-dce36bf0b087 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Getting quotas for project 3fca9208950f4d1a92bd52b4e5f5b2a1. Resources: {'key_pairs'} {{(pid=127198) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 16:37:04.681938 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.quota [None req-65a8b112-b16a-45b2-ac22-dce36bf0b087 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Getting quotas for user f8bd900e231242c3ae67432d26d089da and project 3fca9208950f4d1a92bd52b4e5f5b2a1. Resources: {'key_pairs'} {{(pid=127198) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 16:37:04.704334 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-65a8b112-b16a-45b2-ac22-dce36bf0b087 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.047720 Sep 09 16:37:04.704925 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 343/684] 10.222.0.23 () {62 vars in 1200 bytes} [Fri Sep 9 16:37:04 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 49 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 09 16:37:04.766815 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-f1a766cb-7d01-4d41-a64d-fdb6ca332dab tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:37:04.768756 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-f1a766cb-7d01-4d41-a64d-fdb6ca332dab tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] [instance: cc41312a-3de8-4584-9bcf-a1f31b952025] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:37:04.781771 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f1a766cb-7d01-4d41-a64d-fdb6ca332dab tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:37:04.782431 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f1a766cb-7d01-4d41-a64d-fdb6ca332dab tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:37:04.782957 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f1a766cb-7d01-4d41-a64d-fdb6ca332dab tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:37:04.784065 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f1a766cb-7d01-4d41-a64d-fdb6ca332dab tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:37:04.784786 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f1a766cb-7d01-4d41-a64d-fdb6ca332dab tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:37:04.785747 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f1a766cb-7d01-4d41-a64d-fdb6ca332dab tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:37:04.813164 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.wsgi [None req-f1a766cb-7d01-4d41-a64d-fdb6ca332dab tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] HTTP exception thrown: Instance cc41312a-3de8-4584-9bcf-a1f31b952025 could not be found. Sep 09 16:37:04.814879 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-f1a766cb-7d01-4d41-a64d-fdb6ca332dab tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Request method failure captured: Sep 09 16:37:04.814879 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: request: GET /compute/v2.1/servers/cc41312a-3de8-4584-9bcf-a1f31b952025 HTTP/1.1 Sep 09 16:37:04.814879 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Accept: application/json Sep 09 16:37:04.814879 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Accept-Encoding: identity Sep 09 16:37:04.814879 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Connection: close Sep 09 16:37:04.814879 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Content-Length: 0 Sep 09 16:37:04.814879 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Content-Type: application/json Sep 09 16:37:04.814879 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Host: 10.222.0.23 Sep 09 16:37:04.814879 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Openstack-System-Scope: None Sep 09 16:37:04.814879 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: User-Agent: python-urllib3/1.26.12 Sep 09 16:37:04.814879 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Auth-Token: gAAAAABjG2p-0YVzE1C54y4YHzerR9fl8ogYekOzuznZ1bfrL9kUVfW6Ih02eq7nOq40QjAAw9fvfdATGoMCwd4vVva2idcU68ciSkDoKd8Q2lSb22phiMWNOP_KzlG5zPAX_USx2tS2bKk8URzwp5NdlHntDfA3_G1B81ZhfjolUxo8_fp6MfY Sep 09 16:37:04.814879 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Domain-Id: None Sep 09 16:37:04.814879 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Domain-Name: None Sep 09 16:37:04.814879 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Identity-Status: Confirmed Sep 09 16:37:04.814879 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Is-Admin-Project: True Sep 09 16:37:04.814879 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Project-Domain-Id: default Sep 09 16:37:04.814879 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Project-Domain-Name: Default Sep 09 16:37:04.814879 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Project-Id: d21ab544d0b547919794e3efb49ba0e9 Sep 09 16:37:04.814879 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1054417282 Sep 09 16:37:04.814879 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Role: member,reader Sep 09 16:37:04.814879 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Roles: member,reader Sep 09 16:37:04.816152 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d21ab544d0b547919794e3efb49ba0e9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d21ab544d0b547919794e3efb49ba0e9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d21ab544d0b547919794e3efb49ba0e9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d21ab544d0b547919794e3efb49ba0e9"}]}] Sep 09 16:37:04.816152 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1054417282 Sep 09 16:37:04.816152 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Tenant-Id: d21ab544d0b547919794e3efb49ba0e9 Sep 09 16:37:04.816152 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1054417282 Sep 09 16:37:04.816152 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-User: tempest-ServerRescueNegativeTestJSON-1054417282-project Sep 09 16:37:04.816152 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-User-Domain-Id: default Sep 09 16:37:04.816152 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-User-Domain-Name: Default Sep 09 16:37:04.816152 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-User-Id: 67d86f09c6304121be2021cb5c15e63e Sep 09 16:37:04.816152 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1054417282-project Sep 09 16:37:04.816152 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: method: > Sep 09 16:37:04.816152 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: exception: Instance cc41312a-3de8-4584-9bcf-a1f31b952025 could not be found. Sep 09 16:37:04.816152 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: action_args: {'id': 'cc41312a-3de8-4584-9bcf-a1f31b952025'} Sep 09 16:37:04.816974 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 16:37:04.816974 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:37:04.816974 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 16:37:04.816974 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 16:37:04.816974 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 16:37:04.816974 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 16:37:04.816974 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 16:37:04.816974 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 16:37:04.816974 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 16:37:04.816974 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 16:37:04.816974 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc41312a-3de8-4584-9bcf-a1f31b952025 could not be found. Sep 09 16:37:04.816974 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Sep 09 16:37:04.816974 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 16:37:04.816974 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Sep 09 16:37:04.816974 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:37:04.816974 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 16:37:04.816974 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 16:37:04.816974 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 16:37:04.816974 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 16:37:04.816974 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 16:37:04.818260 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 16:37:04.818260 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 16:37:04.818260 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 16:37:04.818260 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 16:37:04.818260 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 16:37:04.818260 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 16:37:04.818260 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 16:37:04.818260 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc41312a-3de8-4584-9bcf-a1f31b952025 could not be found. Sep 09 16:37:04.818260 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Sep 09 16:37:04.818260 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 16:37:04.818260 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Sep 09 16:37:04.818260 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:37:04.818260 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 16:37:04.818260 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 16:37:04.818260 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 16:37:04.818260 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 16:37:04.818260 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc41312a-3de8-4584-9bcf-a1f31b952025 could not be found. Sep 09 16:37:04.818260 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Sep 09 16:37:04.819620 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-13f76ba5-8448-476c-83cc-ec124c74d53e tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:37:04.819714 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-f1a766cb-7d01-4d41-a64d-fdb6ca332dab tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] Returning 404 to user: Instance cc41312a-3de8-4584-9bcf-a1f31b952025 could not be found. {{(pid=127196) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 16:37:04.819807 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-13f76ba5-8448-476c-83cc-ec124c74d53e tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] [instance: 11fefdc7-238f-4580-96f8-d4ba861abeea] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:37:04.819893 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-f1a766cb-7d01-4d41-a64d-fdb6ca332dab tempest-ServerRescueNegativeTestJSON-1054417282 tempest-ServerRescueNegativeTestJSON-1054417282-project] 10.222.0.23 "GET /compute/v2.1/servers/cc41312a-3de8-4584-9bcf-a1f31b952025" status: 404 len: 111 microversion: 2.1 time: 0.054721 Sep 09 16:37:04.821254 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 342/685] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:37:04 2022] GET /compute/v2.1/servers/cc41312a-3de8-4584-9bcf-a1f31b952025 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 16:37:04.821343 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:UPDATE=3,nova_api:INSERT=1 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:37:04.830862 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-13f76ba5-8448-476c-83cc-ec124c74d53e tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:37:04.831441 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-13f76ba5-8448-476c-83cc-ec124c74d53e tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:37:04.831890 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-13f76ba5-8448-476c-83cc-ec124c74d53e tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:37:04.832617 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-13f76ba5-8448-476c-83cc-ec124c74d53e tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:37:04.833068 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-13f76ba5-8448-476c-83cc-ec124c74d53e tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:37:04.833605 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-13f76ba5-8448-476c-83cc-ec124c74d53e tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:37:04.891716 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-13f76ba5-8448-476c-83cc-ec124c74d53e tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:37:04.893621 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-13f76ba5-8448-476c-83cc-ec124c74d53e tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:37:04.894650 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-13f76ba5-8448-476c-83cc-ec124c74d53e tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:37:04.896004 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.objects.instance [None req-13f76ba5-8448-476c-83cc-ec124c74d53e tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lazy-loading 'fault' on Instance uuid 11fefdc7-238f-4580-96f8-d4ba861abeea {{(pid=127198) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 16:37:04.962765 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-13f76ba5-8448-476c-83cc-ec124c74d53e tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c0721dc18343b18993ff5af098841d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17967a941be4a04bbc180e2cf3a7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:37:04.971564 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-13f76ba5-8448-476c-83cc-ec124c74d53e tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] 10.222.0.23 "GET /compute/v2.1/servers/11fefdc7-238f-4580-96f8-d4ba861abeea" status: 200 len: 1332 microversion: 2.1 time: 0.159961 Sep 09 16:37:04.972473 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 344/686] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:37:04 2022] GET /compute/v2.1/servers/11fefdc7-238f-4580-96f8-d4ba861abeea => generated 1332 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 16:37:05.996036 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-6d255d21-f191-4916-ae55-9d96ce051cba tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:37:05.996859 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-6d255d21-f191-4916-ae55-9d96ce051cba tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] [instance: 11fefdc7-238f-4580-96f8-d4ba861abeea] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:37:06.003167 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-6d255d21-f191-4916-ae55-9d96ce051cba tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:37:06.003624 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-6d255d21-f191-4916-ae55-9d96ce051cba tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:37:06.004270 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-6d255d21-f191-4916-ae55-9d96ce051cba tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:37:06.004964 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-6d255d21-f191-4916-ae55-9d96ce051cba tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:37:06.005439 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-6d255d21-f191-4916-ae55-9d96ce051cba tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:37:06.006100 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-6d255d21-f191-4916-ae55-9d96ce051cba tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:37:06.021369 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.wsgi [None req-6d255d21-f191-4916-ae55-9d96ce051cba tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] HTTP exception thrown: Instance 11fefdc7-238f-4580-96f8-d4ba861abeea could not be found. Sep 09 16:37:06.023251 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-6d255d21-f191-4916-ae55-9d96ce051cba tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Request method failure captured: Sep 09 16:37:06.023251 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: request: GET /compute/v2.1/servers/11fefdc7-238f-4580-96f8-d4ba861abeea HTTP/1.1 Sep 09 16:37:06.023251 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Accept: application/json Sep 09 16:37:06.023251 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Accept-Encoding: identity Sep 09 16:37:06.023251 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Connection: close Sep 09 16:37:06.023251 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Content-Length: 0 Sep 09 16:37:06.023251 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Content-Type: application/json Sep 09 16:37:06.023251 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Host: 10.222.0.23 Sep 09 16:37:06.023251 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Openstack-System-Scope: None Sep 09 16:37:06.023251 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: User-Agent: python-urllib3/1.26.12 Sep 09 16:37:06.023251 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Auth-Token: gAAAAABjG2p8X7ru_JB5hJR44VQ2gJJ5-pnimmT3rRqiF7PaDSUV6TptFJkJ5B7Brlh3RUo94RsnCU-lX7lENCapIWQjRtP9b5hcyxC2h1lMkUs_mIUD6GO84yl6hoSKhKDmYwez2Ale62nt_G9YgAJhsj7sSTM8MyBYvPk9Cs4OYzLEWXRgGoo Sep 09 16:37:06.023251 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Domain-Id: None Sep 09 16:37:06.023251 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Domain-Name: None Sep 09 16:37:06.023251 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Identity-Status: Confirmed Sep 09 16:37:06.023251 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Is-Admin-Project: True Sep 09 16:37:06.023251 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Project-Domain-Id: default Sep 09 16:37:06.023251 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Project-Domain-Name: Default Sep 09 16:37:06.023251 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Project-Id: e17967a941be4a04bbc180e2cf3a7a55 Sep 09 16:37:06.023251 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Project-Name: tempest-AttachVolumeNegativeTest-456905727 Sep 09 16:37:06.023251 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Role: member,reader Sep 09 16:37:06.023251 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Roles: member,reader Sep 09 16:37:06.024610 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e17967a941be4a04bbc180e2cf3a7a55"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e17967a941be4a04bbc180e2cf3a7a55"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e17967a941be4a04bbc180e2cf3a7a55"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e17967a941be4a04bbc180e2cf3a7a55"}]}] Sep 09 16:37:06.024610 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Tenant: tempest-AttachVolumeNegativeTest-456905727 Sep 09 16:37:06.024610 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Tenant-Id: e17967a941be4a04bbc180e2cf3a7a55 Sep 09 16:37:06.024610 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-456905727 Sep 09 16:37:06.024610 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-User: tempest-AttachVolumeNegativeTest-456905727-project Sep 09 16:37:06.024610 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-User-Domain-Id: default Sep 09 16:37:06.024610 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-User-Domain-Name: Default Sep 09 16:37:06.024610 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-User-Id: 53c0721dc18343b18993ff5af098841d Sep 09 16:37:06.024610 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-User-Name: tempest-AttachVolumeNegativeTest-456905727-project Sep 09 16:37:06.024610 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: method: > Sep 09 16:37:06.024610 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: exception: Instance 11fefdc7-238f-4580-96f8-d4ba861abeea could not be found. Sep 09 16:37:06.024610 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: action_args: {'id': '11fefdc7-238f-4580-96f8-d4ba861abeea'} Sep 09 16:37:06.025333 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 16:37:06.025333 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:37:06.025333 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 16:37:06.025333 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 16:37:06.025333 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 16:37:06.025333 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 16:37:06.025333 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 16:37:06.025333 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 16:37:06.025333 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 16:37:06.025333 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 16:37:06.025333 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11fefdc7-238f-4580-96f8-d4ba861abeea could not be found. Sep 09 16:37:06.025333 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Sep 09 16:37:06.025333 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 16:37:06.025333 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Sep 09 16:37:06.025333 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:37:06.025333 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 16:37:06.025333 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 16:37:06.025333 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 16:37:06.025333 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 16:37:06.025333 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 16:37:06.026550 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 16:37:06.026550 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 16:37:06.026550 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 16:37:06.026550 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 16:37:06.026550 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 16:37:06.026550 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 16:37:06.026550 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 16:37:06.026550 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11fefdc7-238f-4580-96f8-d4ba861abeea could not be found. Sep 09 16:37:06.026550 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Sep 09 16:37:06.026550 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 16:37:06.026550 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Sep 09 16:37:06.026550 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:37:06.026550 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 16:37:06.026550 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 16:37:06.026550 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 16:37:06.026550 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 16:37:06.026550 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11fefdc7-238f-4580-96f8-d4ba861abeea could not be found. Sep 09 16:37:06.026550 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Sep 09 16:37:06.027620 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-6d255d21-f191-4916-ae55-9d96ce051cba tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Returning 404 to user: Instance 11fefdc7-238f-4580-96f8-d4ba861abeea could not be found. {{(pid=127196) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 16:37:06.027620 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-6d255d21-f191-4916-ae55-9d96ce051cba tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] 10.222.0.23 "GET /compute/v2.1/servers/11fefdc7-238f-4580-96f8-d4ba861abeea" status: 404 len: 111 microversion: 2.1 time: 0.032638 Sep 09 16:37:06.027620 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 343/687] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:37:05 2022] GET /compute/v2.1/servers/11fefdc7-238f-4580-96f8-d4ba861abeea => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 16:37:06.033736 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-dab42390-cf07-4a58-a911-ac3b2e19aab7 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Calling method '.version_select at 0x7f24fb4be9d0>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:37:06.056572 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-dab42390-cf07-4a58-a911-ac3b2e19aab7 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2067039022" status: 202 len: 0 microversion: 2.1 time: 0.026672 Sep 09 16:37:06.057727 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 345/688] 10.222.0.23 () {58 vars in 1221 bytes} [Fri Sep 9 16:37:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2067039022 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 16:37:06.549106 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-714812f2-afc3-48a6-80d6-49689bf9147a tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-726376455", "imageRef": "0b1ba34f-2223-497a-9a18-c2ad8d398aae", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "da9ecde3-ba10-4e48-a429-5d8e9112473b"}], "security_groups": [{"name": "tempest-securitygroup--146323561"}], "key_name": "tempest-keypair-766971705", "user_data": "}} {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:37:06.656794 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.network.neutron [None req-714812f2-afc3-48a6-80d6-49689bf9147a tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] validate_networks() for [('da9ecde3-ba10-4e48-a429-5d8e9112473b', None, None, None, None, None)] {{(pid=127196) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 16:37:07.107475 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.virt.hardware [None req-714812f2-afc3-48a6-80d6-49689bf9147a tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Flavor limits 0:0:0 {{(pid=127196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 16:37:07.108046 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.virt.hardware [None req-714812f2-afc3-48a6-80d6-49689bf9147a tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Image limits 0:0:0 {{(pid=127196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 16:37:07.108361 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.virt.hardware [None req-714812f2-afc3-48a6-80d6-49689bf9147a tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Flavor pref 0:0:0 {{(pid=127196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 16:37:07.108763 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.virt.hardware [None req-714812f2-afc3-48a6-80d6-49689bf9147a tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Image pref 0:0:0 {{(pid=127196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 16:37:07.109159 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.virt.hardware [None req-714812f2-afc3-48a6-80d6-49689bf9147a tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 16:37:07.118332 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-714812f2-afc3-48a6-80d6-49689bf9147a tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:37:07.118849 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-714812f2-afc3-48a6-80d6-49689bf9147a tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:37:07.119283 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-714812f2-afc3-48a6-80d6-49689bf9147a tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:37:07.120009 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-714812f2-afc3-48a6-80d6-49689bf9147a tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:37:07.120457 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-714812f2-afc3-48a6-80d6-49689bf9147a tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:37:07.120877 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-714812f2-afc3-48a6-80d6-49689bf9147a tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:37:07.142798 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.quota [None req-714812f2-afc3-48a6-80d6-49689bf9147a tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Getting quotas for project 3fca9208950f4d1a92bd52b4e5f5b2a1. Resources: {'cores', 'instances', 'ram'} {{(pid=127196) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 16:37:07.146934 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.quota [None req-714812f2-afc3-48a6-80d6-49689bf9147a tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Getting quotas for user f8bd900e231242c3ae67432d26d089da and project 3fca9208950f4d1a92bd52b4e5f5b2a1. Resources: {'cores', 'instances', 'ram'} {{(pid=127196) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 16:37:07.159636 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-714812f2-afc3-48a6-80d6-49689bf9147a tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Going to run 1 instances... {{(pid=127196) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 16:37:07.162002 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-714812f2-afc3-48a6-80d6-49689bf9147a tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: e20f4f93-c27e-4971-a495-a3498f2611eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0b1ba34f-2223-497a-9a18-c2ad8d398aae',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127196) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 16:37:07.216641 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-714812f2-afc3-48a6-80d6-49689bf9147a tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.668987 Sep 09 16:37:07.216641 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 344/689] 10.222.0.23 () {62 vars in 1188 bytes} [Fri Sep 9 16:37:06 2022] POST /compute/v2.1/servers => generated 401 bytes in 670 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 09 16:37:07.222892 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-3d46b368-a7dd-40c6-ada6-111802841471 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Action: 'create', calling method: .version_select at 0x7f24fb498af0>, body: {"keypair": {"name": "tempest-keypair-86085779", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFmj7pG94NFA+KyhmU0HIesGunNtdWZp43jBA9fAJnyhMHNDu+txA1jUWzM5nMNv1+GWbffDP60TxhlInYty83rZl1eXZzOZyV3/VhPWqTwwqif6Anq2xK4mVvxRLelK4A=="}} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:37:07.224819 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-c6bc75e8-553f-4a1a-8dee-7561041202f8 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:37:07.225495 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-c6bc75e8-553f-4a1a-8dee-7561041202f8 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: e20f4f93-c27e-4971-a495-a3498f2611eb] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:37:07.248739 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.quota [None req-3d46b368-a7dd-40c6-ada6-111802841471 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Getting quotas for project e17967a941be4a04bbc180e2cf3a7a55. Resources: {'key_pairs'} {{(pid=127198) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 16:37:07.255449 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.quota [None req-3d46b368-a7dd-40c6-ada6-111802841471 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Getting quotas for user 53c0721dc18343b18993ff5af098841d and project e17967a941be4a04bbc180e2cf3a7a55. Resources: {'key_pairs'} {{(pid=127198) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 16:37:07.309593 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-3d46b368-a7dd-40c6-ada6-111802841471 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.090237 Sep 09 16:37:07.318380 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 346/690] 10.222.0.23 () {60 vars in 1159 bytes} [Fri Sep 9 16:37:07 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 16:37:07.340680 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-c6bc75e8-553f-4a1a-8dee-7561041202f8 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:37:07.350580 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-c6bc75e8-553f-4a1a-8dee-7561041202f8 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:37:07.352248 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-c6bc75e8-553f-4a1a-8dee-7561041202f8 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:37:07.354255 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-c6bc75e8-553f-4a1a-8dee-7561041202f8 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb" status: 200 len: 1280 microversion: 2.20 time: 0.133667 Sep 09 16:37:07.370832 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 345/691] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Sep 9 16:37:07 2022] GET /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb => generated 1280 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 16:37:08.381927 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-7521f03d-6be4-47c1-8403-e82b8b81340c tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:37:08.383089 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-7521f03d-6be4-47c1-8403-e82b8b81340c tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: e20f4f93-c27e-4971-a495-a3498f2611eb] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:37:08.389131 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7521f03d-6be4-47c1-8403-e82b8b81340c tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:37:08.389687 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7521f03d-6be4-47c1-8403-e82b8b81340c tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:37:08.390301 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7521f03d-6be4-47c1-8403-e82b8b81340c tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:37:08.391022 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7521f03d-6be4-47c1-8403-e82b8b81340c tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:37:08.391629 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7521f03d-6be4-47c1-8403-e82b8b81340c tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:37:08.392049 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7521f03d-6be4-47c1-8403-e82b8b81340c tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:37:08.464698 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-7521f03d-6be4-47c1-8403-e82b8b81340c tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:37:08.475373 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-7521f03d-6be4-47c1-8403-e82b8b81340c tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:37:08.477154 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-7521f03d-6be4-47c1-8403-e82b8b81340c tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:37:08.478560 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-7521f03d-6be4-47c1-8403-e82b8b81340c tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb" status: 200 len: 1332 microversion: 2.20 time: 0.101709 Sep 09 16:37:08.496476 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 347/692] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Sep 9 16:37:08 2022] GET /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb => generated 1332 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 16:37:09.218650 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-39e04c89-5191-46b4-b7cb-3776dd87acea tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1074047639", "imageRef": "0b1ba34f-2223-497a-9a18-c2ad8d398aae", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5831de5e-0ff3-4415-b956-35183f0be5e2"}], "security_groups": [{"name": "tempest-securitygroup--403421329"}], "key_name": "tempest-keypair-86085779", "user_data": "}} {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:37:09.384499 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.network.neutron [None req-39e04c89-5191-46b4-b7cb-3776dd87acea tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] validate_networks() for [('5831de5e-0ff3-4415-b956-35183f0be5e2', None, None, None, None, None)] {{(pid=127196) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 16:37:09.504519 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-3fa7810c-da10-413b-8869-4eccebafccf9 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:37:09.505134 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-3fa7810c-da10-413b-8869-4eccebafccf9 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: e20f4f93-c27e-4971-a495-a3498f2611eb] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:37:09.511652 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3fa7810c-da10-413b-8869-4eccebafccf9 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:37:09.512504 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3fa7810c-da10-413b-8869-4eccebafccf9 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:37:09.518570 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3fa7810c-da10-413b-8869-4eccebafccf9 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:37:09.519428 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3fa7810c-da10-413b-8869-4eccebafccf9 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:37:09.519972 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3fa7810c-da10-413b-8869-4eccebafccf9 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:37:09.520396 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3fa7810c-da10-413b-8869-4eccebafccf9 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:37:09.625040 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-3fa7810c-da10-413b-8869-4eccebafccf9 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:37:09.638998 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-3fa7810c-da10-413b-8869-4eccebafccf9 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:37:09.640669 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-3fa7810c-da10-413b-8869-4eccebafccf9 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:37:09.641709 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-3fa7810c-da10-413b-8869-4eccebafccf9 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb" status: 200 len: 1338 microversion: 2.20 time: 0.141252 Sep 09 16:37:09.642344 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 348/693] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Sep 9 16:37:09 2022] GET /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb => generated 1338 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 16:37:09.949405 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.virt.hardware [None req-39e04c89-5191-46b4-b7cb-3776dd87acea tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Flavor limits 0:0:0 {{(pid=127196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 16:37:09.949821 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.virt.hardware [None req-39e04c89-5191-46b4-b7cb-3776dd87acea tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Image limits 0:0:0 {{(pid=127196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 16:37:09.950698 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.virt.hardware [None req-39e04c89-5191-46b4-b7cb-3776dd87acea tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Flavor pref 0:0:0 {{(pid=127196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 16:37:09.951198 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.virt.hardware [None req-39e04c89-5191-46b4-b7cb-3776dd87acea tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Image pref 0:0:0 {{(pid=127196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 16:37:09.951892 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.virt.hardware [None req-39e04c89-5191-46b4-b7cb-3776dd87acea tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 16:37:09.962211 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-39e04c89-5191-46b4-b7cb-3776dd87acea tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:37:09.962845 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-39e04c89-5191-46b4-b7cb-3776dd87acea tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:37:09.963992 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-39e04c89-5191-46b4-b7cb-3776dd87acea tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:37:09.965813 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-39e04c89-5191-46b4-b7cb-3776dd87acea tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:37:09.966351 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-39e04c89-5191-46b4-b7cb-3776dd87acea tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:37:09.966863 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-39e04c89-5191-46b4-b7cb-3776dd87acea tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:37:09.982682 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG dbcounter [-] [127196] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:37:09.990557 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.quota [None req-39e04c89-5191-46b4-b7cb-3776dd87acea tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Getting quotas for project e17967a941be4a04bbc180e2cf3a7a55. Resources: {'cores', 'instances', 'ram'} {{(pid=127196) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 16:37:09.996757 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.quota [None req-39e04c89-5191-46b4-b7cb-3776dd87acea tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Getting quotas for user 53c0721dc18343b18993ff5af098841d and project e17967a941be4a04bbc180e2cf3a7a55. Resources: {'cores', 'instances', 'ram'} {{(pid=127196) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 16:37:10.009551 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-39e04c89-5191-46b4-b7cb-3776dd87acea tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Going to run 1 instances... {{(pid=127196) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 16:37:10.011747 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-39e04c89-5191-46b4-b7cb-3776dd87acea tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] [instance: f511030a-fedd-48ec-9d7e-c1b04ea08bc4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0b1ba34f-2223-497a-9a18-c2ad8d398aae',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127196) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 16:37:10.061647 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-39e04c89-5191-46b4-b7cb-3776dd87acea tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.848526 Sep 09 16:37:10.062950 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 346/694] 10.222.0.23 () {60 vars in 1147 bytes} [Fri Sep 9 16:37:09 2022] POST /compute/v2.1/servers => generated 401 bytes in 851 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 16:37:10.076263 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-ba30f657-0084-465d-9ed3-72ddb553d44b tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:37:10.077037 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-ba30f657-0084-465d-9ed3-72ddb553d44b tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] [instance: f511030a-fedd-48ec-9d7e-c1b04ea08bc4] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:37:10.170774 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-ba30f657-0084-465d-9ed3-72ddb553d44b tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c0721dc18343b18993ff5af098841d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17967a941be4a04bbc180e2cf3a7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:37:10.179619 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-ba30f657-0084-465d-9ed3-72ddb553d44b tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] 10.222.0.23 "GET /compute/v2.1/servers/f511030a-fedd-48ec-9d7e-c1b04ea08bc4" status: 200 len: 1240 microversion: 2.1 time: 0.109370 Sep 09 16:37:10.180820 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 349/695] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:37:10 2022] GET /compute/v2.1/servers/f511030a-fedd-48ec-9d7e-c1b04ea08bc4 => generated 1240 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:37:10.608759 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [req-704d6e15-6f5b-416c-b9c1-bf1df30bcf2f req-0652e536-3c68-4dad-8593-b752de71c93d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e20f4f93-c27e-4971-a495-a3498f2611eb", "tag": "8bab0b25-2131-47ef-88e3-210f0d9e7556"}]} {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:37:10.626945 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [req-704d6e15-6f5b-416c-b9c1-bf1df30bcf2f req-0652e536-3c68-4dad-8593-b752de71c93d service nova] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:37:10.627884 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [req-704d6e15-6f5b-416c-b9c1-bf1df30bcf2f req-0652e536-3c68-4dad-8593-b752de71c93d service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:37:10.629389 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [req-704d6e15-6f5b-416c-b9c1-bf1df30bcf2f req-0652e536-3c68-4dad-8593-b752de71c93d service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:37:10.644422 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.compute.server_external_events [req-704d6e15-6f5b-416c-b9c1-bf1df30bcf2f req-0652e536-3c68-4dad-8593-b752de71c93d service nova] Creating event network-changed:8bab0b25-2131-47ef-88e3-210f0d9e7556 for instance e20f4f93-c27e-4971-a495-a3498f2611eb on hv-cinder-83124 Sep 09 16:37:10.649760 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [req-704d6e15-6f5b-416c-b9c1-bf1df30bcf2f req-0652e536-3c68-4dad-8593-b752de71c93d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046889 Sep 09 16:37:10.650948 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 347/696] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Sep 9 16:37:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:37:10.673623 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-06bdd612-2020-468f-b1cf-78fdf631cca3 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:37:10.674180 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-06bdd612-2020-468f-b1cf-78fdf631cca3 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: e20f4f93-c27e-4971-a495-a3498f2611eb] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:37:10.681706 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-06bdd612-2020-468f-b1cf-78fdf631cca3 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:37:10.682244 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-06bdd612-2020-468f-b1cf-78fdf631cca3 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:37:10.682769 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-06bdd612-2020-468f-b1cf-78fdf631cca3 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:37:10.683526 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-06bdd612-2020-468f-b1cf-78fdf631cca3 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:37:10.684080 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-06bdd612-2020-468f-b1cf-78fdf631cca3 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:37:10.685108 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-06bdd612-2020-468f-b1cf-78fdf631cca3 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:37:10.843219 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-06bdd612-2020-468f-b1cf-78fdf631cca3 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:37:10.847340 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:37:10.853398 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-06bdd612-2020-468f-b1cf-78fdf631cca3 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:37:10.855772 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-06bdd612-2020-468f-b1cf-78fdf631cca3 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:37:10.859824 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-06bdd612-2020-468f-b1cf-78fdf631cca3 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb" status: 200 len: 1405 microversion: 2.20 time: 0.189094 Sep 09 16:37:10.860663 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 350/697] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Sep 9 16:37:10 2022] GET /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb => generated 1405 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 16:37:10.982298 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-72226be4-6ef9-4ec7-87e8-c2e80a3e566d tempest-VolumesGetTestJSON-257707342 tempest-VolumesGetTestJSON-257707342-project] Action: 'create', calling method: .version_select at 0x7f24fb55f8b0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1057781018", "metadata": {"Type": "work"}}} {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:37:11.219169 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-e06a43e6-a451-44c1-ae80-eb5feb14c7a0 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:37:11.219973 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-e06a43e6-a451-44c1-ae80-eb5feb14c7a0 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] [instance: f511030a-fedd-48ec-9d7e-c1b04ea08bc4] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:37:11.227305 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e06a43e6-a451-44c1-ae80-eb5feb14c7a0 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:37:11.230869 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e06a43e6-a451-44c1-ae80-eb5feb14c7a0 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:37:11.233119 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e06a43e6-a451-44c1-ae80-eb5feb14c7a0 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:37:11.234200 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e06a43e6-a451-44c1-ae80-eb5feb14c7a0 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:37:11.236347 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e06a43e6-a451-44c1-ae80-eb5feb14c7a0 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:37:11.236874 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e06a43e6-a451-44c1-ae80-eb5feb14c7a0 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:37:11.302264 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-72226be4-6ef9-4ec7-87e8-c2e80a3e566d tempest-VolumesGetTestJSON-257707342 tempest-VolumesGetTestJSON-257707342-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.452677 Sep 09 16:37:11.310520 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 348/698] 10.222.0.23 () {60 vars in 1156 bytes} [Fri Sep 9 16:37:10 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 454 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 09 16:37:11.315773 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-e0e8fd05-ea89-4bca-9601-f5afcb7987a4 tempest-VolumesGetTestJSON-257707342 tempest-VolumesGetTestJSON-257707342-project] Calling method '.version_select at 0x7f24fb620430>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:37:11.346030 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-e06a43e6-a451-44c1-ae80-eb5feb14c7a0 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c0721dc18343b18993ff5af098841d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17967a941be4a04bbc180e2cf3a7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:37:11.368215 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-e06a43e6-a451-44c1-ae80-eb5feb14c7a0 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] 10.222.0.23 "GET /compute/v2.1/servers/f511030a-fedd-48ec-9d7e-c1b04ea08bc4" status: 200 len: 1292 microversion: 2.1 time: 0.166644 Sep 09 16:37:11.375066 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-e0e8fd05-ea89-4bca-9601-f5afcb7987a4 tempest-VolumesGetTestJSON-257707342 tempest-VolumesGetTestJSON-257707342-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/3244499e-2937-4eb1-9de5-59e535f561a2" status: 200 len: 353 microversion: 2.1 time: 0.062851 Sep 09 16:37:11.376008 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 349/699] 10.222.0.23 () {58 vars in 1245 bytes} [Fri Sep 9 16:37:11 2022] GET /compute/v2.1/os-volumes/3244499e-2937-4eb1-9de5-59e535f561a2 => generated 353 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:37:11.385505 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 351/700] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:37:11 2022] GET /compute/v2.1/servers/f511030a-fedd-48ec-9d7e-c1b04ea08bc4 => generated 1292 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 16:37:11.889524 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-672df543-fba2-4101-b6ad-111602e6a2df tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:37:11.891612 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-672df543-fba2-4101-b6ad-111602e6a2df tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: e20f4f93-c27e-4971-a495-a3498f2611eb] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:37:11.900873 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-672df543-fba2-4101-b6ad-111602e6a2df tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:37:11.901629 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-672df543-fba2-4101-b6ad-111602e6a2df tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:37:11.902327 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-672df543-fba2-4101-b6ad-111602e6a2df tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:37:11.903464 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-672df543-fba2-4101-b6ad-111602e6a2df tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:37:11.904186 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-672df543-fba2-4101-b6ad-111602e6a2df tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:37:11.904850 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-672df543-fba2-4101-b6ad-111602e6a2df tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:37:12.045419 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-672df543-fba2-4101-b6ad-111602e6a2df tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:37:12.057783 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-672df543-fba2-4101-b6ad-111602e6a2df tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:37:12.059965 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-672df543-fba2-4101-b6ad-111602e6a2df tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:37:12.061596 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-672df543-fba2-4101-b6ad-111602e6a2df tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb" status: 200 len: 1405 microversion: 2.20 time: 0.179433 Sep 09 16:37:12.062406 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 350/701] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Sep 9 16:37:11 2022] GET /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb => generated 1405 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 16:37:12.390834 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-e14dc454-3186-4ebc-b365-bccc16ec76d7 tempest-VolumesGetTestJSON-257707342 tempest-VolumesGetTestJSON-257707342-project] Calling method '.version_select at 0x7f24fb530790>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:37:12.392619 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-96ffb256-fb81-4f94-8126-b5e79ae84bef tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:37:12.393485 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-96ffb256-fb81-4f94-8126-b5e79ae84bef tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] [instance: f511030a-fedd-48ec-9d7e-c1b04ea08bc4] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:37:12.400578 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-96ffb256-fb81-4f94-8126-b5e79ae84bef tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:37:12.401062 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-96ffb256-fb81-4f94-8126-b5e79ae84bef tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:37:12.401830 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-96ffb256-fb81-4f94-8126-b5e79ae84bef tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:37:12.402554 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-96ffb256-fb81-4f94-8126-b5e79ae84bef tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:37:12.403007 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-96ffb256-fb81-4f94-8126-b5e79ae84bef tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:37:12.403422 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-96ffb256-fb81-4f94-8126-b5e79ae84bef tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:37:12.444203 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-e14dc454-3186-4ebc-b365-bccc16ec76d7 tempest-VolumesGetTestJSON-257707342 tempest-VolumesGetTestJSON-257707342-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/3244499e-2937-4eb1-9de5-59e535f561a2" status: 200 len: 354 microversion: 2.1 time: 0.058145 Sep 09 16:37:12.444707 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 352/702] 10.222.0.23 () {58 vars in 1245 bytes} [Fri Sep 9 16:37:12 2022] GET /compute/v2.1/os-volumes/3244499e-2937-4eb1-9de5-59e535f561a2 => generated 354 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:37:12.457307 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-3d4dfe0e-2bad-400e-b5b5-a623acb91e69 tempest-VolumesGetTestJSON-257707342 tempest-VolumesGetTestJSON-257707342-project] Calling method '.version_select at 0x7f24fb5bbca0>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:37:12.493397 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-96ffb256-fb81-4f94-8126-b5e79ae84bef tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c0721dc18343b18993ff5af098841d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17967a941be4a04bbc180e2cf3a7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:37:12.501363 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-96ffb256-fb81-4f94-8126-b5e79ae84bef tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] 10.222.0.23 "GET /compute/v2.1/servers/f511030a-fedd-48ec-9d7e-c1b04ea08bc4" status: 200 len: 1298 microversion: 2.1 time: 0.112600 Sep 09 16:37:12.513575 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 351/703] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:37:12 2022] GET /compute/v2.1/servers/f511030a-fedd-48ec-9d7e-c1b04ea08bc4 => generated 1298 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 16:37:12.515097 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-3d4dfe0e-2bad-400e-b5b5-a623acb91e69 tempest-VolumesGetTestJSON-257707342 tempest-VolumesGetTestJSON-257707342-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/3244499e-2937-4eb1-9de5-59e535f561a2" status: 200 len: 354 microversion: 2.1 time: 0.061382 Sep 09 16:37:12.516121 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 353/704] 10.222.0.23 () {58 vars in 1245 bytes} [Fri Sep 9 16:37:12 2022] GET /compute/v2.1/os-volumes/3244499e-2937-4eb1-9de5-59e535f561a2 => generated 354 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:37:12.535949 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-8f542bfe-03e5-4468-8263-693ad2565c1c tempest-VolumesGetTestJSON-257707342 tempest-VolumesGetTestJSON-257707342-project] Calling method '.version_select at 0x7f24fb5a6160>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:37:12.607716 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-8f542bfe-03e5-4468-8263-693ad2565c1c tempest-VolumesGetTestJSON-257707342 tempest-VolumesGetTestJSON-257707342-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/3244499e-2937-4eb1-9de5-59e535f561a2" status: 202 len: 0 microversion: 2.1 time: 0.076290 Sep 09 16:37:12.608747 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 352/705] 10.222.0.23 () {58 vars in 1248 bytes} [Fri Sep 9 16:37:12 2022] DELETE /compute/v2.1/os-volumes/3244499e-2937-4eb1-9de5-59e535f561a2 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 16:37:12.619741 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-34661083-5ecb-4887-a479-e584ae0e1120 tempest-VolumesGetTestJSON-257707342 tempest-VolumesGetTestJSON-257707342-project] Calling method '.version_select at 0x7f24fb486790>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:37:12.673207 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-34661083-5ecb-4887-a479-e584ae0e1120 tempest-VolumesGetTestJSON-257707342 tempest-VolumesGetTestJSON-257707342-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/3244499e-2937-4eb1-9de5-59e535f561a2" status: 200 len: 353 microversion: 2.1 time: 0.059270 Sep 09 16:37:12.673796 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 354/706] 10.222.0.23 () {58 vars in 1245 bytes} [Fri Sep 9 16:37:12 2022] GET /compute/v2.1/os-volumes/3244499e-2937-4eb1-9de5-59e535f561a2 => generated 353 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:37:13.089455 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-c6439a57-454e-481b-9200-a3e8b6bb2975 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:37:13.090593 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-c6439a57-454e-481b-9200-a3e8b6bb2975 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: e20f4f93-c27e-4971-a495-a3498f2611eb] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:37:13.096908 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-c6439a57-454e-481b-9200-a3e8b6bb2975 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:37:13.097386 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-c6439a57-454e-481b-9200-a3e8b6bb2975 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:37:13.097815 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-c6439a57-454e-481b-9200-a3e8b6bb2975 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:37:13.098632 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-c6439a57-454e-481b-9200-a3e8b6bb2975 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:37:13.099268 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-c6439a57-454e-481b-9200-a3e8b6bb2975 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:37:13.099689 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-c6439a57-454e-481b-9200-a3e8b6bb2975 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:37:13.295078 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-c6439a57-454e-481b-9200-a3e8b6bb2975 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:37:13.304975 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-c6439a57-454e-481b-9200-a3e8b6bb2975 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:37:13.306406 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-c6439a57-454e-481b-9200-a3e8b6bb2975 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:37:13.307539 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-c6439a57-454e-481b-9200-a3e8b6bb2975 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb" status: 200 len: 1405 microversion: 2.20 time: 0.224684 Sep 09 16:37:13.308109 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 353/707] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Sep 9 16:37:13 2022] GET /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb => generated 1405 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 16:37:13.526617 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-62e6a4ab-be21-429f-9810-7c095597abed tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:37:13.527180 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-62e6a4ab-be21-429f-9810-7c095597abed tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] [instance: f511030a-fedd-48ec-9d7e-c1b04ea08bc4] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:37:13.533892 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-62e6a4ab-be21-429f-9810-7c095597abed tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:37:13.534312 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-62e6a4ab-be21-429f-9810-7c095597abed tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:37:13.534892 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-62e6a4ab-be21-429f-9810-7c095597abed tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:37:13.535684 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-62e6a4ab-be21-429f-9810-7c095597abed tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:37:13.536341 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-62e6a4ab-be21-429f-9810-7c095597abed tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:37:13.536750 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-62e6a4ab-be21-429f-9810-7c095597abed tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:37:13.580879 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [req-38501c3d-20ee-406b-85e8-8210f3ed9885 req-a4192761-d2bc-47e0-8c48-5c7980970511 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f511030a-fedd-48ec-9d7e-c1b04ea08bc4", "tag": "7662be08-e4ae-4f9d-96b8-1d3efec3f6c1"}]} {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:37:13.590880 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [req-38501c3d-20ee-406b-85e8-8210f3ed9885 req-a4192761-d2bc-47e0-8c48-5c7980970511 service nova] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:37:13.591502 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [req-38501c3d-20ee-406b-85e8-8210f3ed9885 req-a4192761-d2bc-47e0-8c48-5c7980970511 service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:37:13.592028 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [req-38501c3d-20ee-406b-85e8-8210f3ed9885 req-a4192761-d2bc-47e0-8c48-5c7980970511 service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:37:13.609187 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.compute.server_external_events [req-38501c3d-20ee-406b-85e8-8210f3ed9885 req-a4192761-d2bc-47e0-8c48-5c7980970511 service nova] Creating event network-changed:7662be08-e4ae-4f9d-96b8-1d3efec3f6c1 for instance f511030a-fedd-48ec-9d7e-c1b04ea08bc4 on hv-cinder-83124 Sep 09 16:37:13.614229 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [req-38501c3d-20ee-406b-85e8-8210f3ed9885 req-a4192761-d2bc-47e0-8c48-5c7980970511 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042817 Sep 09 16:37:13.615425 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 354/708] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Sep 9 16:37:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:37:13.688240 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-ebd7a1a6-7246-42e6-b87b-34923cb8fa80 tempest-VolumesGetTestJSON-257707342 tempest-VolumesGetTestJSON-257707342-project] Calling method '.version_select at 0x7f24fb5a6310>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:37:13.717117 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.wsgi [None req-ebd7a1a6-7246-42e6-b87b-34923cb8fa80 tempest-VolumesGetTestJSON-257707342 tempest-VolumesGetTestJSON-257707342-project] HTTP exception thrown: Volume 3244499e-2937-4eb1-9de5-59e535f561a2 could not be found. Sep 09 16:37:13.719211 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-ebd7a1a6-7246-42e6-b87b-34923cb8fa80 tempest-VolumesGetTestJSON-257707342 tempest-VolumesGetTestJSON-257707342-project] Request method failure captured: Sep 09 16:37:13.719211 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: request: GET /compute/v2.1/os-volumes/3244499e-2937-4eb1-9de5-59e535f561a2 HTTP/1.1 Sep 09 16:37:13.719211 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Accept: application/json Sep 09 16:37:13.719211 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Accept-Encoding: identity Sep 09 16:37:13.719211 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Connection: close Sep 09 16:37:13.719211 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Content-Length: 0 Sep 09 16:37:13.719211 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Content-Type: application/json Sep 09 16:37:13.719211 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Host: 10.222.0.23 Sep 09 16:37:13.719211 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Openstack-System-Scope: None Sep 09 16:37:13.719211 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: User-Agent: python-urllib3/1.26.12 Sep 09 16:37:13.719211 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Auth-Token: gAAAAABjG2u2-ixD9OwFNF3O-AcyYW7w4lgeThTfDJmZl7BRh7PQFD9nKLnBPTtYHJmlDe5Vf_GQhd9D4UkNyIHfyHh8EXCXcIrRfB_vG6VQREHI-8sWABeAyTwd7mk6PeSu8yFLFQfJzwoDm5CtsA0CqgV6czlWcxZBjdCFJiiV43VZmjVqpKo Sep 09 16:37:13.719211 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Domain-Id: None Sep 09 16:37:13.719211 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Domain-Name: None Sep 09 16:37:13.719211 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Identity-Status: Confirmed Sep 09 16:37:13.719211 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Is-Admin-Project: True Sep 09 16:37:13.719211 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Project-Domain-Id: default Sep 09 16:37:13.719211 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Project-Domain-Name: Default Sep 09 16:37:13.719211 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Project-Id: eaf3fd2238b04a1fafd2c6e7055edeb2 Sep 09 16:37:13.719211 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Project-Name: tempest-VolumesGetTestJSON-257707342 Sep 09 16:37:13.719211 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Role: member,reader Sep 09 16:37:13.719211 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Roles: member,reader Sep 09 16:37:13.720751 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/eaf3fd2238b04a1fafd2c6e7055edeb2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/eaf3fd2238b04a1fafd2c6e7055edeb2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/eaf3fd2238b04a1fafd2c6e7055edeb2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_eaf3fd2238b04a1fafd2c6e7055edeb2"}]}] Sep 09 16:37:13.720751 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Tenant: tempest-VolumesGetTestJSON-257707342 Sep 09 16:37:13.720751 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Tenant-Id: eaf3fd2238b04a1fafd2c6e7055edeb2 Sep 09 16:37:13.720751 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Tenant-Name: tempest-VolumesGetTestJSON-257707342 Sep 09 16:37:13.720751 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-User: tempest-VolumesGetTestJSON-257707342-project Sep 09 16:37:13.720751 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-User-Domain-Id: default Sep 09 16:37:13.720751 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-User-Domain-Name: Default Sep 09 16:37:13.720751 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-User-Id: fadb20b58d984c0fb470661662c95da8 Sep 09 16:37:13.720751 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-User-Name: tempest-VolumesGetTestJSON-257707342-project Sep 09 16:37:13.720751 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: method: Sep 09 16:37:13.720751 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: exception: Volume 3244499e-2937-4eb1-9de5-59e535f561a2 could not be found. Sep 09 16:37:13.720751 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: action_args: {'id': '3244499e-2937-4eb1-9de5-59e535f561a2'} Sep 09 16:37:13.720751 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 16:37:13.721631 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:37:13.721631 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 16:37:13.721631 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 16:37:13.721631 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 09 16:37:13.721631 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 09 16:37:13.721631 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 09 16:37:13.721631 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 09 16:37:13.721631 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 09 16:37:13.721631 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 09 16:37:13.721631 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 09 16:37:13.721631 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 09 16:37:13.721631 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 16:37:13.721631 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 16:37:13.721631 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 16:37:13.721631 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 16:37:13.721631 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3244499e-2937-4eb1-9de5-59e535f561a2 could not be found. (HTTP 404) (Request-ID: req-c1b2060e-b6d9-430f-8e70-e0d5df68af71) Sep 09 16:37:13.721631 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Sep 09 16:37:13.721631 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 16:37:13.721631 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Sep 09 16:37:13.722980 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:37:13.722980 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 09 16:37:13.722980 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 09 16:37:13.722980 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 09 16:37:13.722980 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 09 16:37:13.722980 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 09 16:37:13.722980 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 09 16:37:13.722980 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 09 16:37:13.722980 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 09 16:37:13.722980 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 16:37:13.722980 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 16:37:13.722980 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 09 16:37:13.722980 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 09 16:37:13.722980 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 09 16:37:13.722980 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 09 16:37:13.722980 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 09 16:37:13.722980 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 09 16:37:13.722980 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 09 16:37:13.722980 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 09 16:37:13.724336 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 16:37:13.724336 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 16:37:13.724336 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 16:37:13.724336 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 16:37:13.724336 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3244499e-2937-4eb1-9de5-59e535f561a2 could not be found. Sep 09 16:37:13.724336 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Sep 09 16:37:13.724336 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 16:37:13.724336 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Sep 09 16:37:13.724336 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:37:13.724336 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 16:37:13.724336 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 16:37:13.724336 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 16:37:13.724336 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 16:37:13.724336 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 16:37:13.724336 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 16:37:13.724336 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 16:37:13.724336 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 16:37:13.724336 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 09 16:37:13.724336 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 16:37:13.725807 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3244499e-2937-4eb1-9de5-59e535f561a2 could not be found. Sep 09 16:37:13.725807 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Sep 09 16:37:13.725807 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 16:37:13.725807 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Sep 09 16:37:13.725807 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:37:13.725807 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 16:37:13.725807 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 16:37:13.725807 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 16:37:13.725807 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 16:37:13.725807 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3244499e-2937-4eb1-9de5-59e535f561a2 could not be found. Sep 09 16:37:13.725807 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Sep 09 16:37:13.725807 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-ebd7a1a6-7246-42e6-b87b-34923cb8fa80 tempest-VolumesGetTestJSON-257707342 tempest-VolumesGetTestJSON-257707342-project] Returning 404 to user: Volume 3244499e-2937-4eb1-9de5-59e535f561a2 could not be found. {{(pid=127196) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 16:37:13.725807 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-ebd7a1a6-7246-42e6-b87b-34923cb8fa80 tempest-VolumesGetTestJSON-257707342 tempest-VolumesGetTestJSON-257707342-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/3244499e-2937-4eb1-9de5-59e535f561a2" status: 404 len: 109 microversion: 2.1 time: 0.036858 Sep 09 16:37:13.725807 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 355/709] 10.222.0.23 () {58 vars in 1245 bytes} [Fri Sep 9 16:37:13 2022] GET /compute/v2.1/os-volumes/3244499e-2937-4eb1-9de5-59e535f561a2 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 09 16:37:13.811309 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-62e6a4ab-be21-429f-9810-7c095597abed tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c0721dc18343b18993ff5af098841d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17967a941be4a04bbc180e2cf3a7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:37:13.819708 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-62e6a4ab-be21-429f-9810-7c095597abed tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] 10.222.0.23 "GET /compute/v2.1/servers/f511030a-fedd-48ec-9d7e-c1b04ea08bc4" status: 200 len: 1365 microversion: 2.1 time: 0.297559 Sep 09 16:37:13.833117 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 355/710] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:37:13 2022] GET /compute/v2.1/servers/f511030a-fedd-48ec-9d7e-c1b04ea08bc4 => generated 1365 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:37:14.333525 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-06ed7687-5c5e-4faf-976b-3935f2b3cce6 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:37:14.334225 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-06ed7687-5c5e-4faf-976b-3935f2b3cce6 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: e20f4f93-c27e-4971-a495-a3498f2611eb] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:37:14.341679 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-06ed7687-5c5e-4faf-976b-3935f2b3cce6 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:37:14.342169 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-06ed7687-5c5e-4faf-976b-3935f2b3cce6 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:37:14.342635 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-06ed7687-5c5e-4faf-976b-3935f2b3cce6 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:37:14.343314 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-06ed7687-5c5e-4faf-976b-3935f2b3cce6 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:37:14.343765 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-06ed7687-5c5e-4faf-976b-3935f2b3cce6 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:37:14.344183 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-06ed7687-5c5e-4faf-976b-3935f2b3cce6 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:37:14.497901 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-06ed7687-5c5e-4faf-976b-3935f2b3cce6 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:37:14.507007 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-06ed7687-5c5e-4faf-976b-3935f2b3cce6 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:37:14.508460 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-06ed7687-5c5e-4faf-976b-3935f2b3cce6 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:37:14.509608 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-06ed7687-5c5e-4faf-976b-3935f2b3cce6 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb" status: 200 len: 1405 microversion: 2.20 time: 0.180793 Sep 09 16:37:14.510156 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 356/711] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Sep 9 16:37:14 2022] GET /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb => generated 1405 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 16:37:14.843201 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-a8f43b9a-5c5a-4988-83d3-b56c0eb2097f tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:37:14.843814 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-a8f43b9a-5c5a-4988-83d3-b56c0eb2097f tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] [instance: f511030a-fedd-48ec-9d7e-c1b04ea08bc4] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:37:14.850735 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a8f43b9a-5c5a-4988-83d3-b56c0eb2097f tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:37:14.851202 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a8f43b9a-5c5a-4988-83d3-b56c0eb2097f tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:37:14.851906 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a8f43b9a-5c5a-4988-83d3-b56c0eb2097f tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:37:14.852595 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a8f43b9a-5c5a-4988-83d3-b56c0eb2097f tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:37:14.853047 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a8f43b9a-5c5a-4988-83d3-b56c0eb2097f tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:37:14.853445 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a8f43b9a-5c5a-4988-83d3-b56c0eb2097f tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:37:15.127242 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-a8f43b9a-5c5a-4988-83d3-b56c0eb2097f tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c0721dc18343b18993ff5af098841d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17967a941be4a04bbc180e2cf3a7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:37:15.137586 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-a8f43b9a-5c5a-4988-83d3-b56c0eb2097f tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] 10.222.0.23 "GET /compute/v2.1/servers/f511030a-fedd-48ec-9d7e-c1b04ea08bc4" status: 200 len: 1365 microversion: 2.1 time: 0.298010 Sep 09 16:37:15.138693 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 356/712] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:37:14 2022] GET /compute/v2.1/servers/f511030a-fedd-48ec-9d7e-c1b04ea08bc4 => generated 1365 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:37:15.536514 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-fd807a7e-86dc-459a-833b-543f424473b5 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:37:15.537175 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-fd807a7e-86dc-459a-833b-543f424473b5 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: e20f4f93-c27e-4971-a495-a3498f2611eb] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:37:15.544124 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-fd807a7e-86dc-459a-833b-543f424473b5 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:37:15.544615 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-fd807a7e-86dc-459a-833b-543f424473b5 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:37:15.545049 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-fd807a7e-86dc-459a-833b-543f424473b5 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:37:15.545761 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-fd807a7e-86dc-459a-833b-543f424473b5 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:37:15.546194 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-fd807a7e-86dc-459a-833b-543f424473b5 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:37:15.546644 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-fd807a7e-86dc-459a-833b-543f424473b5 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:37:15.679203 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-fd807a7e-86dc-459a-833b-543f424473b5 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:37:15.687285 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-fd807a7e-86dc-459a-833b-543f424473b5 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:37:15.688730 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-fd807a7e-86dc-459a-833b-543f424473b5 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:37:15.689839 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-fd807a7e-86dc-459a-833b-543f424473b5 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb" status: 200 len: 1405 microversion: 2.20 time: 0.158166 Sep 09 16:37:15.690554 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 357/713] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Sep 9 16:37:15 2022] GET /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb => generated 1405 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 16:37:16.160429 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-b811db1e-0480-42f4-a56c-63640ab1724c tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:37:16.161067 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-b811db1e-0480-42f4-a56c-63640ab1724c tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] [instance: f511030a-fedd-48ec-9d7e-c1b04ea08bc4] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:37:16.168828 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b811db1e-0480-42f4-a56c-63640ab1724c tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:37:16.169244 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b811db1e-0480-42f4-a56c-63640ab1724c tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:37:16.169643 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b811db1e-0480-42f4-a56c-63640ab1724c tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:37:16.170571 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b811db1e-0480-42f4-a56c-63640ab1724c tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:37:16.171066 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b811db1e-0480-42f4-a56c-63640ab1724c tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:37:16.171714 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b811db1e-0480-42f4-a56c-63640ab1724c tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:37:16.308922 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-b811db1e-0480-42f4-a56c-63640ab1724c tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c0721dc18343b18993ff5af098841d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17967a941be4a04bbc180e2cf3a7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:37:16.318003 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-b811db1e-0480-42f4-a56c-63640ab1724c tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] 10.222.0.23 "GET /compute/v2.1/servers/f511030a-fedd-48ec-9d7e-c1b04ea08bc4" status: 200 len: 1365 microversion: 2.1 time: 0.161490 Sep 09 16:37:16.318594 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 357/714] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:37:16 2022] GET /compute/v2.1/servers/f511030a-fedd-48ec-9d7e-c1b04ea08bc4 => generated 1365 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:37:16.714890 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-27091c51-9a24-4f6e-8042-7c27e24167d6 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:37:16.715566 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-27091c51-9a24-4f6e-8042-7c27e24167d6 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: e20f4f93-c27e-4971-a495-a3498f2611eb] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:37:16.722126 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-27091c51-9a24-4f6e-8042-7c27e24167d6 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:37:16.722635 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-27091c51-9a24-4f6e-8042-7c27e24167d6 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:37:16.723071 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-27091c51-9a24-4f6e-8042-7c27e24167d6 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:37:16.723756 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-27091c51-9a24-4f6e-8042-7c27e24167d6 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:37:16.724255 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-27091c51-9a24-4f6e-8042-7c27e24167d6 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:37:16.724644 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-27091c51-9a24-4f6e-8042-7c27e24167d6 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:37:16.855969 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-27091c51-9a24-4f6e-8042-7c27e24167d6 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:37:16.870710 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-27091c51-9a24-4f6e-8042-7c27e24167d6 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:37:16.872227 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-27091c51-9a24-4f6e-8042-7c27e24167d6 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:37:16.873758 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-27091c51-9a24-4f6e-8042-7c27e24167d6 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb" status: 200 len: 1405 microversion: 2.20 time: 0.162985 Sep 09 16:37:16.874391 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 358/715] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Sep 9 16:37:16 2022] GET /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb => generated 1405 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 16:37:17.197467 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [req-0ba5505b-aa53-4858-99aa-0ebc50e5596b req-b0de51ab-bf90-4115-85a4-329d22db8499 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e20f4f93-c27e-4971-a495-a3498f2611eb", "name": "network-vif-plugged", "status": "completed", "tag": "8bab0b25-2131-47ef-88e3-210f0d9e7556"}]} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:37:17.208844 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-0ba5505b-aa53-4858-99aa-0ebc50e5596b req-b0de51ab-bf90-4115-85a4-329d22db8499 service nova] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:37:17.209397 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-0ba5505b-aa53-4858-99aa-0ebc50e5596b req-b0de51ab-bf90-4115-85a4-329d22db8499 service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:37:17.210014 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-0ba5505b-aa53-4858-99aa-0ebc50e5596b req-b0de51ab-bf90-4115-85a4-329d22db8499 service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:37:17.224059 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.compute.server_external_events [req-0ba5505b-aa53-4858-99aa-0ebc50e5596b req-b0de51ab-bf90-4115-85a4-329d22db8499 service nova] Creating event network-vif-plugged:8bab0b25-2131-47ef-88e3-210f0d9e7556 for instance e20f4f93-c27e-4971-a495-a3498f2611eb on hv-cinder-83124 Sep 09 16:37:17.229822 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [req-0ba5505b-aa53-4858-99aa-0ebc50e5596b req-b0de51ab-bf90-4115-85a4-329d22db8499 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036802 Sep 09 16:37:17.230578 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 358/716] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Sep 9 16:37:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:37:17.342274 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-4da18bd9-ae2d-40d3-8853-36ef7b3e0c04 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:37:17.343266 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-4da18bd9-ae2d-40d3-8853-36ef7b3e0c04 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] [instance: f511030a-fedd-48ec-9d7e-c1b04ea08bc4] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:37:17.350155 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-4da18bd9-ae2d-40d3-8853-36ef7b3e0c04 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:37:17.350707 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-4da18bd9-ae2d-40d3-8853-36ef7b3e0c04 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:37:17.351332 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-4da18bd9-ae2d-40d3-8853-36ef7b3e0c04 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:37:17.352038 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-4da18bd9-ae2d-40d3-8853-36ef7b3e0c04 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:37:17.352494 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-4da18bd9-ae2d-40d3-8853-36ef7b3e0c04 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:37:17.352912 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-4da18bd9-ae2d-40d3-8853-36ef7b3e0c04 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:37:17.589581 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-4da18bd9-ae2d-40d3-8853-36ef7b3e0c04 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c0721dc18343b18993ff5af098841d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17967a941be4a04bbc180e2cf3a7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:37:17.598551 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-4da18bd9-ae2d-40d3-8853-36ef7b3e0c04 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] 10.222.0.23 "GET /compute/v2.1/servers/f511030a-fedd-48ec-9d7e-c1b04ea08bc4" status: 200 len: 1365 microversion: 2.1 time: 0.260977 Sep 09 16:37:17.600040 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 359/717] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:37:17 2022] GET /compute/v2.1/servers/f511030a-fedd-48ec-9d7e-c1b04ea08bc4 => generated 1365 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:37:17.900265 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-cf324e12-2622-4c17-8c35-5564cc054bda tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:37:17.900945 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-cf324e12-2622-4c17-8c35-5564cc054bda tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: e20f4f93-c27e-4971-a495-a3498f2611eb] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:37:17.907288 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cf324e12-2622-4c17-8c35-5564cc054bda tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:37:17.907761 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cf324e12-2622-4c17-8c35-5564cc054bda tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:37:17.908184 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cf324e12-2622-4c17-8c35-5564cc054bda tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:37:17.908865 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cf324e12-2622-4c17-8c35-5564cc054bda tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:37:17.909307 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cf324e12-2622-4c17-8c35-5564cc054bda tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:37:17.909748 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cf324e12-2622-4c17-8c35-5564cc054bda tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:37:18.041862 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-cf324e12-2622-4c17-8c35-5564cc054bda tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:37:18.049974 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-cf324e12-2622-4c17-8c35-5564cc054bda tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:37:18.051503 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-cf324e12-2622-4c17-8c35-5564cc054bda tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:37:18.052719 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-cf324e12-2622-4c17-8c35-5564cc054bda tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb" status: 200 len: 1405 microversion: 2.20 time: 0.156833 Sep 09 16:37:18.053362 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 359/718] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Sep 9 16:37:17 2022] GET /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb => generated 1405 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 16:37:18.624160 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-880ae888-6063-48cb-b3b8-0e38850a185a tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:37:18.624768 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-880ae888-6063-48cb-b3b8-0e38850a185a tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] [instance: f511030a-fedd-48ec-9d7e-c1b04ea08bc4] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:37:18.632613 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-880ae888-6063-48cb-b3b8-0e38850a185a tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:37:18.633194 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-880ae888-6063-48cb-b3b8-0e38850a185a tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:37:18.633695 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-880ae888-6063-48cb-b3b8-0e38850a185a tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:37:18.634678 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-880ae888-6063-48cb-b3b8-0e38850a185a tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:37:18.635352 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-880ae888-6063-48cb-b3b8-0e38850a185a tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:37:18.635952 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-880ae888-6063-48cb-b3b8-0e38850a185a tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:37:18.766934 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-880ae888-6063-48cb-b3b8-0e38850a185a tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c0721dc18343b18993ff5af098841d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17967a941be4a04bbc180e2cf3a7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:37:18.774681 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-880ae888-6063-48cb-b3b8-0e38850a185a tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] 10.222.0.23 "GET /compute/v2.1/servers/f511030a-fedd-48ec-9d7e-c1b04ea08bc4" status: 200 len: 1365 microversion: 2.1 time: 0.154375 Sep 09 16:37:18.775281 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 360/719] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:37:18 2022] GET /compute/v2.1/servers/f511030a-fedd-48ec-9d7e-c1b04ea08bc4 => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:37:19.080776 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-6bb8a121-148f-4d56-8ec9-0b634ba7596e tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:37:19.082181 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-6bb8a121-148f-4d56-8ec9-0b634ba7596e tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: e20f4f93-c27e-4971-a495-a3498f2611eb] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:37:19.091670 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6bb8a121-148f-4d56-8ec9-0b634ba7596e tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:37:19.092031 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6bb8a121-148f-4d56-8ec9-0b634ba7596e tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:37:19.092725 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6bb8a121-148f-4d56-8ec9-0b634ba7596e tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:37:19.093596 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6bb8a121-148f-4d56-8ec9-0b634ba7596e tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:37:19.094362 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6bb8a121-148f-4d56-8ec9-0b634ba7596e tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:37:19.096709 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6bb8a121-148f-4d56-8ec9-0b634ba7596e tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:37:19.245836 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-6bb8a121-148f-4d56-8ec9-0b634ba7596e tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:37:19.257086 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-6bb8a121-148f-4d56-8ec9-0b634ba7596e tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:37:19.259209 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-6bb8a121-148f-4d56-8ec9-0b634ba7596e tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:37:19.260011 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [req-c6bceffb-56fb-4ea5-9a57-18541675be99 req-8f54ab6c-df58-4e31-8a45-85b758037b40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f511030a-fedd-48ec-9d7e-c1b04ea08bc4", "name": "network-vif-plugged", "status": "completed", "tag": "7662be08-e4ae-4f9d-96b8-1d3efec3f6c1"}]} {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:37:19.260883 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-6bb8a121-148f-4d56-8ec9-0b634ba7596e tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb" status: 200 len: 1597 microversion: 2.20 time: 0.185413 Sep 09 16:37:19.261767 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 360/720] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Sep 9 16:37:19 2022] GET /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb => generated 1597 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 16:37:19.269767 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [req-c6bceffb-56fb-4ea5-9a57-18541675be99 req-8f54ab6c-df58-4e31-8a45-85b758037b40 service nova] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:37:19.270389 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [req-c6bceffb-56fb-4ea5-9a57-18541675be99 req-8f54ab6c-df58-4e31-8a45-85b758037b40 service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:37:19.270997 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [req-c6bceffb-56fb-4ea5-9a57-18541675be99 req-8f54ab6c-df58-4e31-8a45-85b758037b40 service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:37:19.284840 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.compute.server_external_events [req-c6bceffb-56fb-4ea5-9a57-18541675be99 req-8f54ab6c-df58-4e31-8a45-85b758037b40 service nova] Creating event network-vif-plugged:7662be08-e4ae-4f9d-96b8-1d3efec3f6c1 for instance f511030a-fedd-48ec-9d7e-c1b04ea08bc4 on hv-cinder-83124 Sep 09 16:37:19.286243 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-c88b836b-65d8-4251-8427-db953be88dca tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:37:19.286794 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-c88b836b-65d8-4251-8427-db953be88dca tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: e20f4f93-c27e-4971-a495-a3498f2611eb] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:37:19.292062 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [req-c6bceffb-56fb-4ea5-9a57-18541675be99 req-8f54ab6c-df58-4e31-8a45-85b758037b40 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035944 Sep 09 16:37:19.293089 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 361/721] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Sep 9 16:37:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 16:37:19.293533 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c88b836b-65d8-4251-8427-db953be88dca tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:37:19.294182 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c88b836b-65d8-4251-8427-db953be88dca tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:37:19.294633 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c88b836b-65d8-4251-8427-db953be88dca tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:37:19.295580 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c88b836b-65d8-4251-8427-db953be88dca tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:37:19.296132 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c88b836b-65d8-4251-8427-db953be88dca tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:37:19.296312 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c88b836b-65d8-4251-8427-db953be88dca tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:37:19.382682 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-c88b836b-65d8-4251-8427-db953be88dca tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.100772 Sep 09 16:37:19.383345 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 361/722] 10.222.0.23 () {60 vars in 1316 bytes} [Fri Sep 9 16:37:19 2022] GET /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb/os-interface => generated 284 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 16:37:19.799350 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-3967cf86-f21a-4a57-8274-d5d754962d03 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:37:19.800633 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-3967cf86-f21a-4a57-8274-d5d754962d03 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] [instance: f511030a-fedd-48ec-9d7e-c1b04ea08bc4] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:37:19.807576 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-3967cf86-f21a-4a57-8274-d5d754962d03 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:37:19.808071 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-3967cf86-f21a-4a57-8274-d5d754962d03 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:37:19.808498 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-3967cf86-f21a-4a57-8274-d5d754962d03 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:37:19.809230 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-3967cf86-f21a-4a57-8274-d5d754962d03 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:37:19.809782 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-3967cf86-f21a-4a57-8274-d5d754962d03 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:37:19.810205 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-3967cf86-f21a-4a57-8274-d5d754962d03 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:37:19.980007 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG dbcounter [-] [127196] Writing DB stats nova_cell0:SELECT=4 {{(pid=127196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:37:20.004577 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG dbcounter [-] [127196] Writing DB stats nova_cell0:SELECT=14 {{(pid=127196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:37:20.060797 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-3967cf86-f21a-4a57-8274-d5d754962d03 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c0721dc18343b18993ff5af098841d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17967a941be4a04bbc180e2cf3a7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:37:20.076948 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-3967cf86-f21a-4a57-8274-d5d754962d03 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] 10.222.0.23 "GET /compute/v2.1/servers/f511030a-fedd-48ec-9d7e-c1b04ea08bc4" status: 200 len: 1365 microversion: 2.1 time: 0.282922 Sep 09 16:37:20.078479 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 362/723] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:37:19 2022] GET /compute/v2.1/servers/f511030a-fedd-48ec-9d7e-c1b04ea08bc4 => generated 1365 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:37:20.754564 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell0:SELECT=10 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:37:20.760517 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [req-46a05da7-99af-4405-88b1-0767b0c359c7 req-6098f63f-d74d-42a4-84cf-e53f0f27d490 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e20f4f93-c27e-4971-a495-a3498f2611eb", "tag": "8bab0b25-2131-47ef-88e3-210f0d9e7556"}]} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:37:20.770936 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-46a05da7-99af-4405-88b1-0767b0c359c7 req-6098f63f-d74d-42a4-84cf-e53f0f27d490 service nova] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:37:20.771710 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-46a05da7-99af-4405-88b1-0767b0c359c7 req-6098f63f-d74d-42a4-84cf-e53f0f27d490 service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:37:20.772152 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-46a05da7-99af-4405-88b1-0767b0c359c7 req-6098f63f-d74d-42a4-84cf-e53f0f27d490 service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:37:20.783668 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.compute.server_external_events [req-46a05da7-99af-4405-88b1-0767b0c359c7 req-6098f63f-d74d-42a4-84cf-e53f0f27d490 service nova] Creating event network-changed:8bab0b25-2131-47ef-88e3-210f0d9e7556 for instance e20f4f93-c27e-4971-a495-a3498f2611eb on hv-cinder-83124 Sep 09 16:37:20.788630 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [req-46a05da7-99af-4405-88b1-0767b0c359c7 req-6098f63f-d74d-42a4-84cf-e53f0f27d490 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035482 Sep 09 16:37:20.789224 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 362/724] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Sep 9 16:37:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 16:37:21.107602 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-954fef60-b497-4a59-b1f4-8352ca1ad76c tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:37:21.113732 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-954fef60-b497-4a59-b1f4-8352ca1ad76c tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] [instance: f511030a-fedd-48ec-9d7e-c1b04ea08bc4] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:37:21.122649 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-954fef60-b497-4a59-b1f4-8352ca1ad76c tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:37:21.124019 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-954fef60-b497-4a59-b1f4-8352ca1ad76c tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:37:21.124563 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-954fef60-b497-4a59-b1f4-8352ca1ad76c tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:37:21.125449 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-954fef60-b497-4a59-b1f4-8352ca1ad76c tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:37:21.126016 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-954fef60-b497-4a59-b1f4-8352ca1ad76c tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:37:21.126679 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-954fef60-b497-4a59-b1f4-8352ca1ad76c tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:37:21.132168 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG dbcounter [-] [127196] Writing DB stats nova_cell1:SELECT=100 {{(pid=127196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:37:21.385673 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-954fef60-b497-4a59-b1f4-8352ca1ad76c tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c0721dc18343b18993ff5af098841d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17967a941be4a04bbc180e2cf3a7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:37:21.398937 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-954fef60-b497-4a59-b1f4-8352ca1ad76c tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] 10.222.0.23 "GET /compute/v2.1/servers/f511030a-fedd-48ec-9d7e-c1b04ea08bc4" status: 200 len: 1365 microversion: 2.1 time: 0.296617 Sep 09 16:37:21.400362 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 363/725] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:37:21 2022] GET /compute/v2.1/servers/f511030a-fedd-48ec-9d7e-c1b04ea08bc4 => generated 1365 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:37:22.423821 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-8242668f-d99e-49d1-a782-d56f8bde141a tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:37:22.424551 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-8242668f-d99e-49d1-a782-d56f8bde141a tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] [instance: f511030a-fedd-48ec-9d7e-c1b04ea08bc4] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:37:22.431193 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8242668f-d99e-49d1-a782-d56f8bde141a tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:37:22.431667 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8242668f-d99e-49d1-a782-d56f8bde141a tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:37:22.432098 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8242668f-d99e-49d1-a782-d56f8bde141a tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:37:22.432769 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8242668f-d99e-49d1-a782-d56f8bde141a tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:37:22.433228 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8242668f-d99e-49d1-a782-d56f8bde141a tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:37:22.433629 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8242668f-d99e-49d1-a782-d56f8bde141a tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:37:22.570376 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-8242668f-d99e-49d1-a782-d56f8bde141a tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c0721dc18343b18993ff5af098841d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17967a941be4a04bbc180e2cf3a7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:37:22.578442 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-8242668f-d99e-49d1-a782-d56f8bde141a tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] 10.222.0.23 "GET /compute/v2.1/servers/f511030a-fedd-48ec-9d7e-c1b04ea08bc4" status: 200 len: 1556 microversion: 2.1 time: 0.159729 Sep 09 16:37:22.579121 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 363/726] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:37:22 2022] GET /compute/v2.1/servers/f511030a-fedd-48ec-9d7e-c1b04ea08bc4 => generated 1556 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:37:22.602138 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-ac9ad013-96a8-48b0-bb5d-078a6bd397e7 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:37:22.602753 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-ac9ad013-96a8-48b0-bb5d-078a6bd397e7 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] [instance: f511030a-fedd-48ec-9d7e-c1b04ea08bc4] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:37:22.609205 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-ac9ad013-96a8-48b0-bb5d-078a6bd397e7 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:37:22.609703 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-ac9ad013-96a8-48b0-bb5d-078a6bd397e7 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:37:22.610129 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-ac9ad013-96a8-48b0-bb5d-078a6bd397e7 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:37:22.610798 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-ac9ad013-96a8-48b0-bb5d-078a6bd397e7 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:37:22.611272 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-ac9ad013-96a8-48b0-bb5d-078a6bd397e7 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:37:22.611682 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-ac9ad013-96a8-48b0-bb5d-078a6bd397e7 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:37:22.693262 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-ac9ad013-96a8-48b0-bb5d-078a6bd397e7 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] 10.222.0.23 "GET /compute/v2.1/servers/f511030a-fedd-48ec-9d7e-c1b04ea08bc4/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095036 Sep 09 16:37:22.693859 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 364/727] 10.222.0.23 () {58 vars in 1275 bytes} [Fri Sep 9 16:37:22 2022] GET /compute/v2.1/servers/f511030a-fedd-48ec-9d7e-c1b04ea08bc4/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:37:23.684071 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [req-3dac82c8-6828-4742-ac63-06b811ecb721 req-4ec50c5e-9e21-4cef-a201-b3e536fe1d39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f511030a-fedd-48ec-9d7e-c1b04ea08bc4", "tag": "7662be08-e4ae-4f9d-96b8-1d3efec3f6c1"}]} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:37:23.694337 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-3dac82c8-6828-4742-ac63-06b811ecb721 req-4ec50c5e-9e21-4cef-a201-b3e536fe1d39 service nova] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:37:23.694863 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-3dac82c8-6828-4742-ac63-06b811ecb721 req-4ec50c5e-9e21-4cef-a201-b3e536fe1d39 service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:37:23.695287 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-3dac82c8-6828-4742-ac63-06b811ecb721 req-4ec50c5e-9e21-4cef-a201-b3e536fe1d39 service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:37:23.706640 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.compute.server_external_events [req-3dac82c8-6828-4742-ac63-06b811ecb721 req-4ec50c5e-9e21-4cef-a201-b3e536fe1d39 service nova] Creating event network-changed:7662be08-e4ae-4f9d-96b8-1d3efec3f6c1 for instance f511030a-fedd-48ec-9d7e-c1b04ea08bc4 on hv-cinder-83124 Sep 09 16:37:23.711662 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [req-3dac82c8-6828-4742-ac63-06b811ecb721 req-4ec50c5e-9e21-4cef-a201-b3e536fe1d39 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031294 Sep 09 16:37:23.712251 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 364/728] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Sep 9 16:37:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:37:24.865011 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-9da1a244-cfd0-4e60-b6fd-2f6657d6b2f9 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:37:24.865518 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-9da1a244-cfd0-4e60-b6fd-2f6657d6b2f9 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] [instance: 8ff53b0d-4020-4a1c-8af5-9cd0fbba8e06] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:37:24.871793 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-9da1a244-cfd0-4e60-b6fd-2f6657d6b2f9 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:37:24.872265 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-9da1a244-cfd0-4e60-b6fd-2f6657d6b2f9 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:37:24.872691 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-9da1a244-cfd0-4e60-b6fd-2f6657d6b2f9 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:37:24.873373 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-9da1a244-cfd0-4e60-b6fd-2f6657d6b2f9 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:37:24.873819 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-9da1a244-cfd0-4e60-b6fd-2f6657d6b2f9 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:37:24.874235 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-9da1a244-cfd0-4e60-b6fd-2f6657d6b2f9 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:37:24.897953 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-9da1a244-cfd0-4e60-b6fd-2f6657d6b2f9 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] 10.222.0.23 "GET /compute/v2.1/servers/8ff53b0d-4020-4a1c-8af5-9cd0fbba8e06/ips" status: 200 len: 145 microversion: 2.1 time: 0.242906 Sep 09 16:37:24.898528 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 365/729] 10.222.0.23 () {58 vars in 1248 bytes} [Fri Sep 9 16:37:24 2022] GET /compute/v2.1/servers/8ff53b0d-4020-4a1c-8af5-9cd0fbba8e06/ips => generated 145 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:37:28.382600 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-8b3b6a1c-2c6d-48f9-9007-de1876f3dbc0 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "863b5162-8995-4c49-81ec-0db0bf570813"}} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:37:28.385049 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-8b3b6a1c-2c6d-48f9-9007-de1876f3dbc0 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] [instance: 8ff53b0d-4020-4a1c-8af5-9cd0fbba8e06] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:37:28.391661 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8b3b6a1c-2c6d-48f9-9007-de1876f3dbc0 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:37:28.392140 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8b3b6a1c-2c6d-48f9-9007-de1876f3dbc0 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:37:28.392572 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8b3b6a1c-2c6d-48f9-9007-de1876f3dbc0 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:37:28.393259 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8b3b6a1c-2c6d-48f9-9007-de1876f3dbc0 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:37:28.393704 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8b3b6a1c-2c6d-48f9-9007-de1876f3dbc0 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:37:28.394127 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8b3b6a1c-2c6d-48f9-9007-de1876f3dbc0 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:37:28.652293 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-8b3b6a1c-2c6d-48f9-9007-de1876f3dbc0 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] 10.222.0.23 "POST /compute/v2.1/servers/8ff53b0d-4020-4a1c-8af5-9cd0fbba8e06/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.276947 Sep 09 16:37:28.652853 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 365/730] 10.222.0.23 () {60 vars in 1323 bytes} [Fri Sep 9 16:37:28 2022] POST /compute/v2.1/servers/8ff53b0d-4020-4a1c-8af5-9cd0fbba8e06/os-volume_attachments => generated 194 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:37:38.376543 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-5fee59f1-7438-48a4-90ce-aa9adaa3c3b2 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:37:38.378862 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-5fee59f1-7438-48a4-90ce-aa9adaa3c3b2 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] [instance: 8ff53b0d-4020-4a1c-8af5-9cd0fbba8e06] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:37:38.381535 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG dbcounter [-] [127196] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=3 {{(pid=127196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:37:38.382187 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG dbcounter [-] [127196] Writing DB stats nova_cell1:SELECT=13 {{(pid=127196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:37:38.390099 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-5fee59f1-7438-48a4-90ce-aa9adaa3c3b2 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:37:38.390604 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-5fee59f1-7438-48a4-90ce-aa9adaa3c3b2 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:37:38.391030 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-5fee59f1-7438-48a4-90ce-aa9adaa3c3b2 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:37:38.391725 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-5fee59f1-7438-48a4-90ce-aa9adaa3c3b2 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:37:38.392171 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-5fee59f1-7438-48a4-90ce-aa9adaa3c3b2 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:37:38.392584 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-5fee59f1-7438-48a4-90ce-aa9adaa3c3b2 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:37:38.423417 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-5fee59f1-7438-48a4-90ce-aa9adaa3c3b2 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] 10.222.0.23 "GET /compute/v2.1/servers/8ff53b0d-4020-4a1c-8af5-9cd0fbba8e06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050853 Sep 09 16:37:38.424023 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 366/731] 10.222.0.23 () {58 vars in 1302 bytes} [Fri Sep 9 16:37:38 2022] GET /compute/v2.1/servers/8ff53b0d-4020-4a1c-8af5-9cd0fbba8e06/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:37:38.434393 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_api:SELECT=51,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:37:38.440727 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-1331eec0-928b-4a90-b440-627f6d4d47c9 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:37:38.441613 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-1331eec0-928b-4a90-b440-627f6d4d47c9 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] [instance: 8ff53b0d-4020-4a1c-8af5-9cd0fbba8e06] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:37:38.451499 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1331eec0-928b-4a90-b440-627f6d4d47c9 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:37:38.451982 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1331eec0-928b-4a90-b440-627f6d4d47c9 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:37:38.452468 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1331eec0-928b-4a90-b440-627f6d4d47c9 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:37:38.453095 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1331eec0-928b-4a90-b440-627f6d4d47c9 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:37:38.453551 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1331eec0-928b-4a90-b440-627f6d4d47c9 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:37:38.453970 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1331eec0-928b-4a90-b440-627f6d4d47c9 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:37:38.483985 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-1331eec0-928b-4a90-b440-627f6d4d47c9 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] 10.222.0.23 "GET /compute/v2.1/servers/8ff53b0d-4020-4a1c-8af5-9cd0fbba8e06/os-volume_attachments/863b5162-8995-4c49-81ec-0db0bf570813" status: 200 len: 194 microversion: 2.1 time: 0.052167 Sep 09 16:37:38.484552 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 366/732] 10.222.0.23 () {58 vars in 1413 bytes} [Fri Sep 9 16:37:38 2022] GET /compute/v2.1/servers/8ff53b0d-4020-4a1c-8af5-9cd0fbba8e06/os-volume_attachments/863b5162-8995-4c49-81ec-0db0bf570813 => generated 194 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:37:39.849233 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-aaac4889-3d02-4ac7-96e2-ea98fa61c134 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "797b190e-2be1-4a11-9d1a-c29225fee579"}} {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:37:39.851627 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-aaac4889-3d02-4ac7-96e2-ea98fa61c134 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] [instance: 8ff53b0d-4020-4a1c-8af5-9cd0fbba8e06] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:37:39.858445 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-aaac4889-3d02-4ac7-96e2-ea98fa61c134 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:37:39.858976 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-aaac4889-3d02-4ac7-96e2-ea98fa61c134 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:37:39.859414 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-aaac4889-3d02-4ac7-96e2-ea98fa61c134 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:37:39.860204 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-aaac4889-3d02-4ac7-96e2-ea98fa61c134 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:37:39.860664 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-aaac4889-3d02-4ac7-96e2-ea98fa61c134 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:37:39.861091 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-aaac4889-3d02-4ac7-96e2-ea98fa61c134 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:37:42.500638 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-aaac4889-3d02-4ac7-96e2-ea98fa61c134 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] 10.222.0.23 "POST /compute/v2.1/servers/8ff53b0d-4020-4a1c-8af5-9cd0fbba8e06/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.655269 Sep 09 16:37:42.501288 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 367/733] 10.222.0.23 () {60 vars in 1323 bytes} [Fri Sep 9 16:37:39 2022] POST /compute/v2.1/servers/8ff53b0d-4020-4a1c-8af5-9cd0fbba8e06/os-volume_attachments => generated 194 bytes in 2657 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:37:50.087955 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-8512bf51-86aa-4d37-837f-c45e9d17a5a5 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:37:50.090251 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-8512bf51-86aa-4d37-837f-c45e9d17a5a5 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] [instance: 8ff53b0d-4020-4a1c-8af5-9cd0fbba8e06] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:37:50.092763 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_api:SELECT=2 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:37:50.093421 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:37:50.099333 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8512bf51-86aa-4d37-837f-c45e9d17a5a5 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:37:50.099889 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8512bf51-86aa-4d37-837f-c45e9d17a5a5 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:37:50.101283 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8512bf51-86aa-4d37-837f-c45e9d17a5a5 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:37:50.101283 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8512bf51-86aa-4d37-837f-c45e9d17a5a5 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:37:50.101499 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8512bf51-86aa-4d37-837f-c45e9d17a5a5 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:37:50.101794 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8512bf51-86aa-4d37-837f-c45e9d17a5a5 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:37:50.133156 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-8512bf51-86aa-4d37-837f-c45e9d17a5a5 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] 10.222.0.23 "GET /compute/v2.1/servers/8ff53b0d-4020-4a1c-8af5-9cd0fbba8e06/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.049863 Sep 09 16:37:50.133714 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 367/734] 10.222.0.23 () {58 vars in 1302 bytes} [Fri Sep 9 16:37:50 2022] GET /compute/v2.1/servers/8ff53b0d-4020-4a1c-8af5-9cd0fbba8e06/os-volume_attachments => generated 371 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:37:50.287996 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG dbcounter [-] [127196] Writing DB stats nova_api:SELECT=4 {{(pid=127196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:37:50.295932 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-38da7c74-da98-4440-ba23-70733c01d315 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:37:50.296884 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-38da7c74-da98-4440-ba23-70733c01d315 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] [instance: 8ff53b0d-4020-4a1c-8af5-9cd0fbba8e06] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:37:50.305036 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-38da7c74-da98-4440-ba23-70733c01d315 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:37:50.305511 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-38da7c74-da98-4440-ba23-70733c01d315 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:37:50.306064 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-38da7c74-da98-4440-ba23-70733c01d315 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:37:50.306805 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-38da7c74-da98-4440-ba23-70733c01d315 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:37:50.307282 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-38da7c74-da98-4440-ba23-70733c01d315 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:37:50.307698 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-38da7c74-da98-4440-ba23-70733c01d315 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:37:50.337178 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-38da7c74-da98-4440-ba23-70733c01d315 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] 10.222.0.23 "GET /compute/v2.1/servers/8ff53b0d-4020-4a1c-8af5-9cd0fbba8e06/os-volume_attachments/863b5162-8995-4c49-81ec-0db0bf570813" status: 200 len: 194 microversion: 2.1 time: 0.052057 Sep 09 16:37:50.337749 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 368/735] 10.222.0.23 () {58 vars in 1413 bytes} [Fri Sep 9 16:37:50 2022] GET /compute/v2.1/servers/8ff53b0d-4020-4a1c-8af5-9cd0fbba8e06/os-volume_attachments/863b5162-8995-4c49-81ec-0db0bf570813 => generated 194 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:37:50.351640 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-f9401b9f-13b9-4e19-aafe-8bf2e40b2290 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:37:50.352641 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-f9401b9f-13b9-4e19-aafe-8bf2e40b2290 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] [instance: 8ff53b0d-4020-4a1c-8af5-9cd0fbba8e06] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:37:50.363087 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f9401b9f-13b9-4e19-aafe-8bf2e40b2290 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:37:50.363567 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f9401b9f-13b9-4e19-aafe-8bf2e40b2290 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:37:50.364007 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f9401b9f-13b9-4e19-aafe-8bf2e40b2290 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:37:50.364688 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f9401b9f-13b9-4e19-aafe-8bf2e40b2290 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:37:50.365140 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f9401b9f-13b9-4e19-aafe-8bf2e40b2290 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:37:50.365561 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f9401b9f-13b9-4e19-aafe-8bf2e40b2290 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:37:50.451545 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.objects.instance [None req-f9401b9f-13b9-4e19-aafe-8bf2e40b2290 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lazy-loading 'services' on Instance uuid 8ff53b0d-4020-4a1c-8af5-9cd0fbba8e06 {{(pid=127198) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 16:37:50.535565 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-f9401b9f-13b9-4e19-aafe-8bf2e40b2290 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] 10.222.0.23 "DELETE /compute/v2.1/servers/8ff53b0d-4020-4a1c-8af5-9cd0fbba8e06/os-volume_attachments/863b5162-8995-4c49-81ec-0db0bf570813" status: 202 len: 0 microversion: 2.1 time: 0.190230 Sep 09 16:37:50.536762 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 368/736] 10.222.0.23 () {58 vars in 1416 bytes} [Fri Sep 9 16:37:50 2022] DELETE /compute/v2.1/servers/8ff53b0d-4020-4a1c-8af5-9cd0fbba8e06/os-volume_attachments/863b5162-8995-4c49-81ec-0db0bf570813 => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 16:37:51.672043 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-d90daf12-53b3-4229-9e65-b06f3e356519 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:37:51.672584 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-d90daf12-53b3-4229-9e65-b06f3e356519 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] [instance: 8ff53b0d-4020-4a1c-8af5-9cd0fbba8e06] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:37:51.682201 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-d90daf12-53b3-4229-9e65-b06f3e356519 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:37:51.682872 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-d90daf12-53b3-4229-9e65-b06f3e356519 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:37:51.683404 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-d90daf12-53b3-4229-9e65-b06f3e356519 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:37:51.684414 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-d90daf12-53b3-4229-9e65-b06f3e356519 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:37:51.685073 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-d90daf12-53b3-4229-9e65-b06f3e356519 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:37:51.685660 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-d90daf12-53b3-4229-9e65-b06f3e356519 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:37:51.717971 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-d90daf12-53b3-4229-9e65-b06f3e356519 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] 10.222.0.23 "GET /compute/v2.1/servers/8ff53b0d-4020-4a1c-8af5-9cd0fbba8e06/os-volume_attachments/797b190e-2be1-4a11-9d1a-c29225fee579" status: 200 len: 194 microversion: 2.1 time: 0.052917 Sep 09 16:37:51.718815 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 369/737] 10.222.0.23 () {58 vars in 1413 bytes} [Fri Sep 9 16:37:51 2022] GET /compute/v2.1/servers/8ff53b0d-4020-4a1c-8af5-9cd0fbba8e06/os-volume_attachments/797b190e-2be1-4a11-9d1a-c29225fee579 => generated 194 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:37:51.732718 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-8d940b08-41a6-4017-a43b-e27672c18870 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:37:51.733277 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-8d940b08-41a6-4017-a43b-e27672c18870 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] [instance: 8ff53b0d-4020-4a1c-8af5-9cd0fbba8e06] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:37:51.740525 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8d940b08-41a6-4017-a43b-e27672c18870 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:37:51.740990 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8d940b08-41a6-4017-a43b-e27672c18870 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:37:51.741430 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8d940b08-41a6-4017-a43b-e27672c18870 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:37:51.742089 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8d940b08-41a6-4017-a43b-e27672c18870 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:37:51.742526 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8d940b08-41a6-4017-a43b-e27672c18870 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:37:51.743074 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8d940b08-41a6-4017-a43b-e27672c18870 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:37:51.831977 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.objects.instance [None req-8d940b08-41a6-4017-a43b-e27672c18870 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lazy-loading 'services' on Instance uuid 8ff53b0d-4020-4a1c-8af5-9cd0fbba8e06 {{(pid=127198) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 16:37:51.908022 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-8d940b08-41a6-4017-a43b-e27672c18870 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] 10.222.0.23 "DELETE /compute/v2.1/servers/8ff53b0d-4020-4a1c-8af5-9cd0fbba8e06/os-volume_attachments/797b190e-2be1-4a11-9d1a-c29225fee579" status: 202 len: 0 microversion: 2.1 time: 0.179498 Sep 09 16:37:51.908833 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 369/738] 10.222.0.23 () {58 vars in 1416 bytes} [Fri Sep 9 16:37:51 2022] DELETE /compute/v2.1/servers/8ff53b0d-4020-4a1c-8af5-9cd0fbba8e06/os-volume_attachments/797b190e-2be1-4a11-9d1a-c29225fee579 => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 16:37:53.107972 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-76d04a43-1db1-46bc-b4cf-a0471b194f52 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:37:53.110334 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-76d04a43-1db1-46bc-b4cf-a0471b194f52 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] [instance: 8ff53b0d-4020-4a1c-8af5-9cd0fbba8e06] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:37:53.116724 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-76d04a43-1db1-46bc-b4cf-a0471b194f52 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:37:53.117273 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-76d04a43-1db1-46bc-b4cf-a0471b194f52 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:37:53.117709 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-76d04a43-1db1-46bc-b4cf-a0471b194f52 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:37:53.118403 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-76d04a43-1db1-46bc-b4cf-a0471b194f52 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:37:53.118880 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-76d04a43-1db1-46bc-b4cf-a0471b194f52 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:37:53.119297 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-76d04a43-1db1-46bc-b4cf-a0471b194f52 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:37:53.149105 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-76d04a43-1db1-46bc-b4cf-a0471b194f52 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] 10.222.0.23 "GET /compute/v2.1/servers/8ff53b0d-4020-4a1c-8af5-9cd0fbba8e06/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045114 Sep 09 16:37:53.149854 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 370/739] 10.222.0.23 () {58 vars in 1302 bytes} [Fri Sep 9 16:37:53 2022] GET /compute/v2.1/servers/8ff53b0d-4020-4a1c-8af5-9cd0fbba8e06/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 09 16:37:53.273296 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-b73d2908-eeae-4537-ac1a-5d948f611185 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:37:53.275653 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-b73d2908-eeae-4537-ac1a-5d948f611185 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] [instance: 8ff53b0d-4020-4a1c-8af5-9cd0fbba8e06] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:37:53.281736 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b73d2908-eeae-4537-ac1a-5d948f611185 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:37:53.282221 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b73d2908-eeae-4537-ac1a-5d948f611185 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:37:53.282709 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b73d2908-eeae-4537-ac1a-5d948f611185 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:37:53.283394 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b73d2908-eeae-4537-ac1a-5d948f611185 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:37:53.283840 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b73d2908-eeae-4537-ac1a-5d948f611185 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:37:53.284266 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b73d2908-eeae-4537-ac1a-5d948f611185 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:37:53.313679 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-b73d2908-eeae-4537-ac1a-5d948f611185 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] 10.222.0.23 "GET /compute/v2.1/servers/8ff53b0d-4020-4a1c-8af5-9cd0fbba8e06/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045220 Sep 09 16:37:53.314467 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 370/740] 10.222.0.23 () {58 vars in 1302 bytes} [Fri Sep 9 16:37:53 2022] GET /compute/v2.1/servers/8ff53b0d-4020-4a1c-8af5-9cd0fbba8e06/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 09 16:37:53.381258 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-363c094c-16f5-405c-a5bd-ec911ba47727 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:37:53.381834 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-363c094c-16f5-405c-a5bd-ec911ba47727 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] [instance: 8ff53b0d-4020-4a1c-8af5-9cd0fbba8e06] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:37:53.387829 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-363c094c-16f5-405c-a5bd-ec911ba47727 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:37:53.388297 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-363c094c-16f5-405c-a5bd-ec911ba47727 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:37:53.388713 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-363c094c-16f5-405c-a5bd-ec911ba47727 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:37:53.389395 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-363c094c-16f5-405c-a5bd-ec911ba47727 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:37:53.389863 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-363c094c-16f5-405c-a5bd-ec911ba47727 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:37:53.390253 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-363c094c-16f5-405c-a5bd-ec911ba47727 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:37:53.415413 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-363c094c-16f5-405c-a5bd-ec911ba47727 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] [instance: 8ff53b0d-4020-4a1c-8af5-9cd0fbba8e06] Going to try to terminate instance {{(pid=127196) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 16:37:53.494013 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-363c094c-16f5-405c-a5bd-ec911ba47727 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] 10.222.0.23 "DELETE /compute/v2.1/servers/8ff53b0d-4020-4a1c-8af5-9cd0fbba8e06" status: 204 len: 0 microversion: 2.1 time: 0.116239 Sep 09 16:37:53.494936 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 371/741] 10.222.0.23 () {58 vars in 1239 bytes} [Fri Sep 9 16:37:53 2022] DELETE /compute/v2.1/servers/8ff53b0d-4020-4a1c-8af5-9cd0fbba8e06 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 16:37:53.504833 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-0822eb9c-ca89-4e93-bfc5-529bcb0740d9 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:37:53.505515 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-0822eb9c-ca89-4e93-bfc5-529bcb0740d9 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] [instance: 8ff53b0d-4020-4a1c-8af5-9cd0fbba8e06] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:37:53.511511 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0822eb9c-ca89-4e93-bfc5-529bcb0740d9 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:37:53.512208 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0822eb9c-ca89-4e93-bfc5-529bcb0740d9 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:37:53.512653 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0822eb9c-ca89-4e93-bfc5-529bcb0740d9 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:37:53.513356 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0822eb9c-ca89-4e93-bfc5-529bcb0740d9 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:37:53.513851 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0822eb9c-ca89-4e93-bfc5-529bcb0740d9 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:37:53.514352 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0822eb9c-ca89-4e93-bfc5-529bcb0740d9 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:37:53.680175 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-0822eb9c-ca89-4e93-bfc5-529bcb0740d9 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd095ed814b9e47e08d6b5a4fd2901c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f2e0c002343d88ae25dc7bfb2fe10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:37:53.688538 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-0822eb9c-ca89-4e93-bfc5-529bcb0740d9 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] 10.222.0.23 "GET /compute/v2.1/servers/8ff53b0d-4020-4a1c-8af5-9cd0fbba8e06" status: 200 len: 1672 microversion: 2.1 time: 0.188782 Sep 09 16:37:53.689119 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 371/742] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:37:53 2022] GET /compute/v2.1/servers/8ff53b0d-4020-4a1c-8af5-9cd0fbba8e06 => generated 1672 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:37:54.712642 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-a4c57e83-cbe0-4e59-8522-42e716b9bc62 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:37:54.713356 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-a4c57e83-cbe0-4e59-8522-42e716b9bc62 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] [instance: 8ff53b0d-4020-4a1c-8af5-9cd0fbba8e06] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:37:54.720031 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-a4c57e83-cbe0-4e59-8522-42e716b9bc62 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:37:54.720583 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-a4c57e83-cbe0-4e59-8522-42e716b9bc62 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:37:54.721007 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-a4c57e83-cbe0-4e59-8522-42e716b9bc62 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:37:54.721751 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-a4c57e83-cbe0-4e59-8522-42e716b9bc62 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:37:54.722212 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-a4c57e83-cbe0-4e59-8522-42e716b9bc62 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:37:54.722669 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-a4c57e83-cbe0-4e59-8522-42e716b9bc62 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:37:54.862209 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-a4c57e83-cbe0-4e59-8522-42e716b9bc62 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd095ed814b9e47e08d6b5a4fd2901c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f2e0c002343d88ae25dc7bfb2fe10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:37:54.870403 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-a4c57e83-cbe0-4e59-8522-42e716b9bc62 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] 10.222.0.23 "GET /compute/v2.1/servers/8ff53b0d-4020-4a1c-8af5-9cd0fbba8e06" status: 200 len: 1672 microversion: 2.1 time: 0.162126 Sep 09 16:37:54.871017 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 372/743] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:37:54 2022] GET /compute/v2.1/servers/8ff53b0d-4020-4a1c-8af5-9cd0fbba8e06 => generated 1672 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:37:55.893265 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-102dd870-8ddb-40ea-9007-dfa79d5da1c9 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:37:55.893945 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-102dd870-8ddb-40ea-9007-dfa79d5da1c9 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] [instance: 8ff53b0d-4020-4a1c-8af5-9cd0fbba8e06] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:37:55.901164 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-102dd870-8ddb-40ea-9007-dfa79d5da1c9 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:37:55.901648 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-102dd870-8ddb-40ea-9007-dfa79d5da1c9 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:37:55.902069 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-102dd870-8ddb-40ea-9007-dfa79d5da1c9 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:37:55.902784 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-102dd870-8ddb-40ea-9007-dfa79d5da1c9 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:37:55.903228 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-102dd870-8ddb-40ea-9007-dfa79d5da1c9 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:37:55.903641 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-102dd870-8ddb-40ea-9007-dfa79d5da1c9 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:37:56.038771 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-102dd870-8ddb-40ea-9007-dfa79d5da1c9 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd095ed814b9e47e08d6b5a4fd2901c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f2e0c002343d88ae25dc7bfb2fe10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:37:56.047396 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-102dd870-8ddb-40ea-9007-dfa79d5da1c9 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] 10.222.0.23 "GET /compute/v2.1/servers/8ff53b0d-4020-4a1c-8af5-9cd0fbba8e06" status: 200 len: 1672 microversion: 2.1 time: 0.157877 Sep 09 16:37:56.059580 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 372/744] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:37:55 2022] GET /compute/v2.1/servers/8ff53b0d-4020-4a1c-8af5-9cd0fbba8e06 => generated 1672 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:37:57.072992 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-9ffc9efd-53c5-4a54-ad0f-f2651f42e121 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:37:57.073745 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-9ffc9efd-53c5-4a54-ad0f-f2651f42e121 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] [instance: 8ff53b0d-4020-4a1c-8af5-9cd0fbba8e06] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:37:57.081901 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-9ffc9efd-53c5-4a54-ad0f-f2651f42e121 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:37:57.082534 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-9ffc9efd-53c5-4a54-ad0f-f2651f42e121 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:37:57.083116 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-9ffc9efd-53c5-4a54-ad0f-f2651f42e121 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:37:57.085753 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-9ffc9efd-53c5-4a54-ad0f-f2651f42e121 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:37:57.086284 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-9ffc9efd-53c5-4a54-ad0f-f2651f42e121 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:37:57.086812 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-9ffc9efd-53c5-4a54-ad0f-f2651f42e121 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:37:57.159597 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-9ffc9efd-53c5-4a54-ad0f-f2651f42e121 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd095ed814b9e47e08d6b5a4fd2901c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f2e0c002343d88ae25dc7bfb2fe10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:37:57.168211 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-9ffc9efd-53c5-4a54-ad0f-f2651f42e121 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] 10.222.0.23 "GET /compute/v2.1/servers/8ff53b0d-4020-4a1c-8af5-9cd0fbba8e06" status: 200 len: 1605 microversion: 2.1 time: 0.099642 Sep 09 16:37:57.169310 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 373/745] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:37:57 2022] GET /compute/v2.1/servers/8ff53b0d-4020-4a1c-8af5-9cd0fbba8e06 => generated 1605 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:37:57.561771 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [req-17bcb9c6-222c-4ae1-b69f-58206c081d2d req-1d73a2e8-5870-4489-932e-0c7a93018278 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ff53b0d-4020-4a1c-8af5-9cd0fbba8e06", "name": "network-vif-deleted", "tag": "0beecb60-e8cf-4260-946b-89ce2b20f0a3"}]} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:37:57.575272 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-17bcb9c6-222c-4ae1-b69f-58206c081d2d req-1d73a2e8-5870-4489-932e-0c7a93018278 service nova] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:37:57.576177 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-17bcb9c6-222c-4ae1-b69f-58206c081d2d req-1d73a2e8-5870-4489-932e-0c7a93018278 service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:37:57.576835 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-17bcb9c6-222c-4ae1-b69f-58206c081d2d req-1d73a2e8-5870-4489-932e-0c7a93018278 service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:37:57.593559 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.compute.server_external_events [req-17bcb9c6-222c-4ae1-b69f-58206c081d2d req-1d73a2e8-5870-4489-932e-0c7a93018278 service nova] Creating event network-vif-deleted:0beecb60-e8cf-4260-946b-89ce2b20f0a3 for instance 8ff53b0d-4020-4a1c-8af5-9cd0fbba8e06 on hv-cinder-83124 Sep 09 16:37:57.601458 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [req-17bcb9c6-222c-4ae1-b69f-58206c081d2d req-1d73a2e8-5870-4489-932e-0c7a93018278 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.262219 Sep 09 16:37:57.603513 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 373/746] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Sep 9 16:37:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:37:58.193025 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-d9728f83-3b36-4130-8ff3-4234e2eca0ac tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:37:58.193641 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-d9728f83-3b36-4130-8ff3-4234e2eca0ac tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] [instance: 8ff53b0d-4020-4a1c-8af5-9cd0fbba8e06] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:37:58.200521 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-d9728f83-3b36-4130-8ff3-4234e2eca0ac tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:37:58.201088 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-d9728f83-3b36-4130-8ff3-4234e2eca0ac tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:37:58.201518 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-d9728f83-3b36-4130-8ff3-4234e2eca0ac tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:37:58.202223 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-d9728f83-3b36-4130-8ff3-4234e2eca0ac tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:37:58.202689 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-d9728f83-3b36-4130-8ff3-4234e2eca0ac tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:37:58.203103 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-d9728f83-3b36-4130-8ff3-4234e2eca0ac tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:37:58.235248 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-d9728f83-3b36-4130-8ff3-4234e2eca0ac tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:37:58.235728 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-d9728f83-3b36-4130-8ff3-4234e2eca0ac tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:37:58.236387 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-d9728f83-3b36-4130-8ff3-4234e2eca0ac tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:37:58.236614 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.objects.instance [None req-d9728f83-3b36-4130-8ff3-4234e2eca0ac tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lazy-loading 'fault' on Instance uuid 8ff53b0d-4020-4a1c-8af5-9cd0fbba8e06 {{(pid=127196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 16:37:58.279399 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-d9728f83-3b36-4130-8ff3-4234e2eca0ac tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd095ed814b9e47e08d6b5a4fd2901c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f2e0c002343d88ae25dc7bfb2fe10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:37:58.287734 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-d9728f83-3b36-4130-8ff3-4234e2eca0ac tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] 10.222.0.23 "GET /compute/v2.1/servers/8ff53b0d-4020-4a1c-8af5-9cd0fbba8e06" status: 200 len: 1327 microversion: 2.1 time: 0.098638 Sep 09 16:37:58.288312 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 374/747] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:37:58 2022] GET /compute/v2.1/servers/8ff53b0d-4020-4a1c-8af5-9cd0fbba8e06 => generated 1327 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:37:59.312731 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-cb0633e7-94d3-4f2b-81ed-5d18898f5a2c tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:37:59.313390 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-cb0633e7-94d3-4f2b-81ed-5d18898f5a2c tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] [instance: 8ff53b0d-4020-4a1c-8af5-9cd0fbba8e06] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:37:59.320165 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cb0633e7-94d3-4f2b-81ed-5d18898f5a2c tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:37:59.320646 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cb0633e7-94d3-4f2b-81ed-5d18898f5a2c tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:37:59.321082 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cb0633e7-94d3-4f2b-81ed-5d18898f5a2c tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:37:59.321767 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cb0633e7-94d3-4f2b-81ed-5d18898f5a2c tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:37:59.322219 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cb0633e7-94d3-4f2b-81ed-5d18898f5a2c tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:37:59.322682 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cb0633e7-94d3-4f2b-81ed-5d18898f5a2c tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:37:59.354416 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cb0633e7-94d3-4f2b-81ed-5d18898f5a2c tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:37:59.354939 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cb0633e7-94d3-4f2b-81ed-5d18898f5a2c tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:37:59.355365 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cb0633e7-94d3-4f2b-81ed-5d18898f5a2c tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:37:59.355807 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.objects.instance [None req-cb0633e7-94d3-4f2b-81ed-5d18898f5a2c tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lazy-loading 'fault' on Instance uuid 8ff53b0d-4020-4a1c-8af5-9cd0fbba8e06 {{(pid=127198) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 16:37:59.409033 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-cb0633e7-94d3-4f2b-81ed-5d18898f5a2c tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd095ed814b9e47e08d6b5a4fd2901c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f2e0c002343d88ae25dc7bfb2fe10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:37:59.417355 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-cb0633e7-94d3-4f2b-81ed-5d18898f5a2c tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] 10.222.0.23 "GET /compute/v2.1/servers/8ff53b0d-4020-4a1c-8af5-9cd0fbba8e06" status: 200 len: 1327 microversion: 2.1 time: 0.109528 Sep 09 16:37:59.417940 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 374/748] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:37:59 2022] GET /compute/v2.1/servers/8ff53b0d-4020-4a1c-8af5-9cd0fbba8e06 => generated 1327 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:38:00.442123 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-f72fcd06-e4e1-4950-a08d-a0d0df546a3a tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:38:00.442865 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-f72fcd06-e4e1-4950-a08d-a0d0df546a3a tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] [instance: 8ff53b0d-4020-4a1c-8af5-9cd0fbba8e06] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:38:00.449595 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f72fcd06-e4e1-4950-a08d-a0d0df546a3a tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:00.450099 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f72fcd06-e4e1-4950-a08d-a0d0df546a3a tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:00.450543 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f72fcd06-e4e1-4950-a08d-a0d0df546a3a tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:00.451489 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f72fcd06-e4e1-4950-a08d-a0d0df546a3a tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:00.451940 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f72fcd06-e4e1-4950-a08d-a0d0df546a3a tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:00.452364 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f72fcd06-e4e1-4950-a08d-a0d0df546a3a tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:00.485966 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f72fcd06-e4e1-4950-a08d-a0d0df546a3a tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:00.486452 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f72fcd06-e4e1-4950-a08d-a0d0df546a3a tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:00.486893 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f72fcd06-e4e1-4950-a08d-a0d0df546a3a tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:00.487321 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.objects.instance [None req-f72fcd06-e4e1-4950-a08d-a0d0df546a3a tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lazy-loading 'fault' on Instance uuid 8ff53b0d-4020-4a1c-8af5-9cd0fbba8e06 {{(pid=127196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 16:38:00.529798 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-f72fcd06-e4e1-4950-a08d-a0d0df546a3a tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd095ed814b9e47e08d6b5a4fd2901c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f2e0c002343d88ae25dc7bfb2fe10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:00.538069 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-f72fcd06-e4e1-4950-a08d-a0d0df546a3a tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] 10.222.0.23 "GET /compute/v2.1/servers/8ff53b0d-4020-4a1c-8af5-9cd0fbba8e06" status: 200 len: 1327 microversion: 2.1 time: 0.100583 Sep 09 16:38:00.539150 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 375/749] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:38:00 2022] GET /compute/v2.1/servers/8ff53b0d-4020-4a1c-8af5-9cd0fbba8e06 => generated 1327 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:38:01.564208 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-acf1b440-877f-4491-ac4f-65362a08597f tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:38:01.564975 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-acf1b440-877f-4491-ac4f-65362a08597f tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] [instance: 8ff53b0d-4020-4a1c-8af5-9cd0fbba8e06] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:38:01.572947 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-acf1b440-877f-4491-ac4f-65362a08597f tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:01.573508 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-acf1b440-877f-4491-ac4f-65362a08597f tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:01.574053 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-acf1b440-877f-4491-ac4f-65362a08597f tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:01.574868 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-acf1b440-877f-4491-ac4f-65362a08597f tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:01.575400 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-acf1b440-877f-4491-ac4f-65362a08597f tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:01.575893 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-acf1b440-877f-4491-ac4f-65362a08597f tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:01.590625 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.wsgi [None req-acf1b440-877f-4491-ac4f-65362a08597f tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] HTTP exception thrown: Instance 8ff53b0d-4020-4a1c-8af5-9cd0fbba8e06 could not be found. Sep 09 16:38:01.592245 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-acf1b440-877f-4491-ac4f-65362a08597f tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Request method failure captured: Sep 09 16:38:01.592245 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: request: GET /compute/v2.1/servers/8ff53b0d-4020-4a1c-8af5-9cd0fbba8e06 HTTP/1.1 Sep 09 16:38:01.592245 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Accept: application/json Sep 09 16:38:01.592245 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Accept-Encoding: identity Sep 09 16:38:01.592245 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Connection: close Sep 09 16:38:01.592245 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Content-Length: 0 Sep 09 16:38:01.592245 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Content-Type: application/json Sep 09 16:38:01.592245 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Host: 10.222.0.23 Sep 09 16:38:01.592245 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Openstack-System-Scope: None Sep 09 16:38:01.592245 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: User-Agent: python-urllib3/1.26.12 Sep 09 16:38:01.592245 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Auth-Token: gAAAAABjG2p5h27SNGzaEpji7SWrLO5cgdqsF7efiLI2ph1vni7NHoRtUz6NkAUldAhjPwUaWVflxxS46FZgyOUf_zmOAGi-dTPqh7WbuBAnycxGx0udk1PEjoMJv7YQhQ0d8oPz8gs7S9PKaOIRpoyjcGeIgaCRey4yIJ-sI0C9gxuQnuVKgbw Sep 09 16:38:01.592245 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Domain-Id: None Sep 09 16:38:01.592245 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Domain-Name: None Sep 09 16:38:01.592245 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Identity-Status: Confirmed Sep 09 16:38:01.592245 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Is-Admin-Project: True Sep 09 16:38:01.592245 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Project-Domain-Id: default Sep 09 16:38:01.592245 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Project-Domain-Name: Default Sep 09 16:38:01.592245 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Project-Id: f90f2e0c002343d88ae25dc7bfb2fe10 Sep 09 16:38:01.592245 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Project-Name: tempest-AttachVolumeTestJSON-1369004595 Sep 09 16:38:01.592245 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Role: member,reader Sep 09 16:38:01.592245 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Roles: member,reader Sep 09 16:38:01.593814 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f90f2e0c002343d88ae25dc7bfb2fe10"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f90f2e0c002343d88ae25dc7bfb2fe10"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f90f2e0c002343d88ae25dc7bfb2fe10"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f90f2e0c002343d88ae25dc7bfb2fe10"}]}] Sep 09 16:38:01.593814 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Tenant: tempest-AttachVolumeTestJSON-1369004595 Sep 09 16:38:01.593814 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Tenant-Id: f90f2e0c002343d88ae25dc7bfb2fe10 Sep 09 16:38:01.593814 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1369004595 Sep 09 16:38:01.593814 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User: tempest-AttachVolumeTestJSON-1369004595-project Sep 09 16:38:01.593814 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User-Domain-Id: default Sep 09 16:38:01.593814 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User-Domain-Name: Default Sep 09 16:38:01.593814 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User-Id: d095ed814b9e47e08d6b5a4fd2901c43 Sep 09 16:38:01.593814 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User-Name: tempest-AttachVolumeTestJSON-1369004595-project Sep 09 16:38:01.593814 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: method: > Sep 09 16:38:01.593814 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: exception: Instance 8ff53b0d-4020-4a1c-8af5-9cd0fbba8e06 could not be found. Sep 09 16:38:01.593814 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: action_args: {'id': '8ff53b0d-4020-4a1c-8af5-9cd0fbba8e06'} Sep 09 16:38:01.594889 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 16:38:01.594889 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:38:01.594889 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 16:38:01.594889 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 16:38:01.594889 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 16:38:01.594889 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 16:38:01.594889 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 16:38:01.594889 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 16:38:01.594889 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 16:38:01.594889 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 16:38:01.594889 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ff53b0d-4020-4a1c-8af5-9cd0fbba8e06 could not be found. Sep 09 16:38:01.594889 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:38:01.594889 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 16:38:01.594889 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:38:01.594889 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:38:01.594889 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 16:38:01.594889 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 16:38:01.594889 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 16:38:01.594889 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 16:38:01.594889 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 16:38:01.596500 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 16:38:01.596500 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 16:38:01.596500 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 16:38:01.596500 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 16:38:01.596500 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 16:38:01.596500 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 16:38:01.596500 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 16:38:01.596500 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ff53b0d-4020-4a1c-8af5-9cd0fbba8e06 could not be found. Sep 09 16:38:01.596500 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:38:01.596500 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 16:38:01.596500 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:38:01.596500 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:38:01.596500 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 16:38:01.596500 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 16:38:01.596500 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 16:38:01.596500 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 16:38:01.596500 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ff53b0d-4020-4a1c-8af5-9cd0fbba8e06 could not be found. Sep 09 16:38:01.596500 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:38:01.597941 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-acf1b440-877f-4491-ac4f-65362a08597f tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Returning 404 to user: Instance 8ff53b0d-4020-4a1c-8af5-9cd0fbba8e06 could not be found. {{(pid=127198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 16:38:01.597941 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-acf1b440-877f-4491-ac4f-65362a08597f tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] 10.222.0.23 "GET /compute/v2.1/servers/8ff53b0d-4020-4a1c-8af5-9cd0fbba8e06" status: 404 len: 111 microversion: 2.1 time: 0.034081 Sep 09 16:38:01.597941 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 375/750] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:38:01 2022] GET /compute/v2.1/servers/8ff53b0d-4020-4a1c-8af5-9cd0fbba8e06 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 16:38:01.602948 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-1d038256-9d2a-4f80-b786-fbb9aa11db92 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Calling method '.version_select at 0x7f24fb67fa60>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:38:01.623710 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-1d038256-9d2a-4f80-b786-fbb9aa11db92 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-360955613" status: 202 len: 0 microversion: 2.1 time: 0.024573 Sep 09 16:38:01.624253 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 376/751] 10.222.0.23 () {58 vars in 1218 bytes} [Fri Sep 9 16:38:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-360955613 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 16:38:04.513959 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-665e3dd8-c968-4fe9-be30-c249aa23173e tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:38:04.514582 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-665e3dd8-c968-4fe9-be30-c249aa23173e tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] [instance: 8ff53b0d-4020-4a1c-8af5-9cd0fbba8e06] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:38:04.521182 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-665e3dd8-c968-4fe9-be30-c249aa23173e tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:04.521849 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-665e3dd8-c968-4fe9-be30-c249aa23173e tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:04.522349 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-665e3dd8-c968-4fe9-be30-c249aa23173e tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:04.523134 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-665e3dd8-c968-4fe9-be30-c249aa23173e tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:04.523685 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-665e3dd8-c968-4fe9-be30-c249aa23173e tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:04.524170 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-665e3dd8-c968-4fe9-be30-c249aa23173e tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:04.538393 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.wsgi [None req-665e3dd8-c968-4fe9-be30-c249aa23173e tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] HTTP exception thrown: Instance 8ff53b0d-4020-4a1c-8af5-9cd0fbba8e06 could not be found. Sep 09 16:38:04.540578 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-665e3dd8-c968-4fe9-be30-c249aa23173e tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Request method failure captured: Sep 09 16:38:04.540578 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: request: DELETE /compute/v2.1/servers/8ff53b0d-4020-4a1c-8af5-9cd0fbba8e06 HTTP/1.1 Sep 09 16:38:04.540578 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Accept: application/json Sep 09 16:38:04.540578 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Accept-Encoding: identity Sep 09 16:38:04.540578 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Connection: close Sep 09 16:38:04.540578 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Content-Length: 0 Sep 09 16:38:04.540578 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Content-Type: application/json Sep 09 16:38:04.540578 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Host: 10.222.0.23 Sep 09 16:38:04.540578 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Openstack-System-Scope: None Sep 09 16:38:04.540578 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: User-Agent: python-urllib3/1.26.12 Sep 09 16:38:04.540578 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Auth-Token: gAAAAABjG2p5h27SNGzaEpji7SWrLO5cgdqsF7efiLI2ph1vni7NHoRtUz6NkAUldAhjPwUaWVflxxS46FZgyOUf_zmOAGi-dTPqh7WbuBAnycxGx0udk1PEjoMJv7YQhQ0d8oPz8gs7S9PKaOIRpoyjcGeIgaCRey4yIJ-sI0C9gxuQnuVKgbw Sep 09 16:38:04.540578 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Domain-Id: None Sep 09 16:38:04.540578 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Domain-Name: None Sep 09 16:38:04.540578 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Identity-Status: Confirmed Sep 09 16:38:04.540578 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Is-Admin-Project: True Sep 09 16:38:04.540578 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Project-Domain-Id: default Sep 09 16:38:04.540578 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Project-Domain-Name: Default Sep 09 16:38:04.540578 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Project-Id: f90f2e0c002343d88ae25dc7bfb2fe10 Sep 09 16:38:04.540578 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Project-Name: tempest-AttachVolumeTestJSON-1369004595 Sep 09 16:38:04.540578 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Role: member,reader Sep 09 16:38:04.540578 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Roles: member,reader Sep 09 16:38:04.541885 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f90f2e0c002343d88ae25dc7bfb2fe10"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f90f2e0c002343d88ae25dc7bfb2fe10"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f90f2e0c002343d88ae25dc7bfb2fe10"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f90f2e0c002343d88ae25dc7bfb2fe10"}]}] Sep 09 16:38:04.541885 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Tenant: tempest-AttachVolumeTestJSON-1369004595 Sep 09 16:38:04.541885 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Tenant-Id: f90f2e0c002343d88ae25dc7bfb2fe10 Sep 09 16:38:04.541885 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1369004595 Sep 09 16:38:04.541885 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User: tempest-AttachVolumeTestJSON-1369004595-project Sep 09 16:38:04.541885 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User-Domain-Id: default Sep 09 16:38:04.541885 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User-Domain-Name: Default Sep 09 16:38:04.541885 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User-Id: d095ed814b9e47e08d6b5a4fd2901c43 Sep 09 16:38:04.541885 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User-Name: tempest-AttachVolumeTestJSON-1369004595-project Sep 09 16:38:04.541885 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: method: > Sep 09 16:38:04.541885 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: exception: Instance 8ff53b0d-4020-4a1c-8af5-9cd0fbba8e06 could not be found. Sep 09 16:38:04.541885 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: action_args: {'id': '8ff53b0d-4020-4a1c-8af5-9cd0fbba8e06'} Sep 09 16:38:04.543295 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 16:38:04.543295 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:38:04.543295 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 16:38:04.543295 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 16:38:04.543295 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 16:38:04.543295 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 16:38:04.543295 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 16:38:04.543295 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 16:38:04.543295 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 16:38:04.543295 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 16:38:04.543295 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ff53b0d-4020-4a1c-8af5-9cd0fbba8e06 could not be found. Sep 09 16:38:04.543295 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:38:04.543295 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 16:38:04.543295 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:38:04.543295 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:38:04.543295 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 16:38:04.543295 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 16:38:04.543295 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 16:38:04.543295 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 16:38:04.543295 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 16:38:04.544487 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 16:38:04.544487 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 09 16:38:04.544487 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 09 16:38:04.544487 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 09 16:38:04.544487 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 09 16:38:04.544487 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 16:38:04.544487 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 16:38:04.544487 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 16:38:04.544487 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 16:38:04.544487 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ff53b0d-4020-4a1c-8af5-9cd0fbba8e06 could not be found. Sep 09 16:38:04.544487 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:38:04.544487 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 16:38:04.544487 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:38:04.544487 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:38:04.544487 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 16:38:04.544487 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 16:38:04.544487 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 16:38:04.544487 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 16:38:04.544487 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ff53b0d-4020-4a1c-8af5-9cd0fbba8e06 could not be found. Sep 09 16:38:04.544487 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:38:04.546147 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-665e3dd8-c968-4fe9-be30-c249aa23173e tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Returning 404 to user: Instance 8ff53b0d-4020-4a1c-8af5-9cd0fbba8e06 could not be found. {{(pid=127198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 16:38:04.547486 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-665e3dd8-c968-4fe9-be30-c249aa23173e tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] 10.222.0.23 "DELETE /compute/v2.1/servers/8ff53b0d-4020-4a1c-8af5-9cd0fbba8e06" status: 404 len: 111 microversion: 2.1 time: 0.036706 Sep 09 16:38:04.553829 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 376/752] 10.222.0.23 () {58 vars in 1239 bytes} [Fri Sep 9 16:38:04 2022] DELETE /compute/v2.1/servers/8ff53b0d-4020-4a1c-8af5-9cd0fbba8e06 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 16:38:04.556635 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-e002deff-0cf1-4d65-ba40-d55fa753dff2 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:38:04.557330 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-e002deff-0cf1-4d65-ba40-d55fa753dff2 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] [instance: 8ff53b0d-4020-4a1c-8af5-9cd0fbba8e06] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:38:04.563557 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e002deff-0cf1-4d65-ba40-d55fa753dff2 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:04.564125 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e002deff-0cf1-4d65-ba40-d55fa753dff2 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:04.564627 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e002deff-0cf1-4d65-ba40-d55fa753dff2 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:04.565451 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e002deff-0cf1-4d65-ba40-d55fa753dff2 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:04.565914 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e002deff-0cf1-4d65-ba40-d55fa753dff2 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:04.566404 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e002deff-0cf1-4d65-ba40-d55fa753dff2 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:04.583175 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.wsgi [None req-e002deff-0cf1-4d65-ba40-d55fa753dff2 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] HTTP exception thrown: Instance 8ff53b0d-4020-4a1c-8af5-9cd0fbba8e06 could not be found. Sep 09 16:38:04.584997 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-e002deff-0cf1-4d65-ba40-d55fa753dff2 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Request method failure captured: Sep 09 16:38:04.584997 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: request: GET /compute/v2.1/servers/8ff53b0d-4020-4a1c-8af5-9cd0fbba8e06 HTTP/1.1 Sep 09 16:38:04.584997 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Accept: application/json Sep 09 16:38:04.584997 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Accept-Encoding: identity Sep 09 16:38:04.584997 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Connection: close Sep 09 16:38:04.584997 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Content-Length: 0 Sep 09 16:38:04.584997 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Content-Type: application/json Sep 09 16:38:04.584997 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Host: 10.222.0.23 Sep 09 16:38:04.584997 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Openstack-System-Scope: None Sep 09 16:38:04.584997 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: User-Agent: python-urllib3/1.26.12 Sep 09 16:38:04.584997 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Auth-Token: gAAAAABjG2p5h27SNGzaEpji7SWrLO5cgdqsF7efiLI2ph1vni7NHoRtUz6NkAUldAhjPwUaWVflxxS46FZgyOUf_zmOAGi-dTPqh7WbuBAnycxGx0udk1PEjoMJv7YQhQ0d8oPz8gs7S9PKaOIRpoyjcGeIgaCRey4yIJ-sI0C9gxuQnuVKgbw Sep 09 16:38:04.584997 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Domain-Id: None Sep 09 16:38:04.584997 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Domain-Name: None Sep 09 16:38:04.584997 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Identity-Status: Confirmed Sep 09 16:38:04.584997 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Is-Admin-Project: True Sep 09 16:38:04.584997 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Project-Domain-Id: default Sep 09 16:38:04.584997 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Project-Domain-Name: Default Sep 09 16:38:04.584997 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Project-Id: f90f2e0c002343d88ae25dc7bfb2fe10 Sep 09 16:38:04.584997 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Project-Name: tempest-AttachVolumeTestJSON-1369004595 Sep 09 16:38:04.584997 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Role: member,reader Sep 09 16:38:04.584997 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Roles: member,reader Sep 09 16:38:04.586477 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f90f2e0c002343d88ae25dc7bfb2fe10"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f90f2e0c002343d88ae25dc7bfb2fe10"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f90f2e0c002343d88ae25dc7bfb2fe10"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f90f2e0c002343d88ae25dc7bfb2fe10"}]}] Sep 09 16:38:04.586477 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Tenant: tempest-AttachVolumeTestJSON-1369004595 Sep 09 16:38:04.586477 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Tenant-Id: f90f2e0c002343d88ae25dc7bfb2fe10 Sep 09 16:38:04.586477 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1369004595 Sep 09 16:38:04.586477 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-User: tempest-AttachVolumeTestJSON-1369004595-project Sep 09 16:38:04.586477 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-User-Domain-Id: default Sep 09 16:38:04.586477 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-User-Domain-Name: Default Sep 09 16:38:04.586477 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-User-Id: d095ed814b9e47e08d6b5a4fd2901c43 Sep 09 16:38:04.586477 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-User-Name: tempest-AttachVolumeTestJSON-1369004595-project Sep 09 16:38:04.586477 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: method: > Sep 09 16:38:04.586477 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: exception: Instance 8ff53b0d-4020-4a1c-8af5-9cd0fbba8e06 could not be found. Sep 09 16:38:04.586477 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: action_args: {'id': '8ff53b0d-4020-4a1c-8af5-9cd0fbba8e06'} Sep 09 16:38:04.587459 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 16:38:04.587459 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:38:04.587459 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 16:38:04.587459 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 16:38:04.587459 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 16:38:04.587459 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 16:38:04.587459 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 16:38:04.587459 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 16:38:04.587459 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 16:38:04.587459 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 16:38:04.587459 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ff53b0d-4020-4a1c-8af5-9cd0fbba8e06 could not be found. Sep 09 16:38:04.587459 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Sep 09 16:38:04.587459 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 16:38:04.587459 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Sep 09 16:38:04.587459 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:38:04.587459 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 16:38:04.587459 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 16:38:04.587459 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 16:38:04.587459 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 16:38:04.587459 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 16:38:04.591975 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 16:38:04.591975 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 16:38:04.591975 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 16:38:04.591975 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 16:38:04.591975 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 16:38:04.591975 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 16:38:04.591975 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 16:38:04.591975 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ff53b0d-4020-4a1c-8af5-9cd0fbba8e06 could not be found. Sep 09 16:38:04.591975 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Sep 09 16:38:04.591975 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 16:38:04.591975 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Sep 09 16:38:04.591975 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:38:04.591975 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 16:38:04.591975 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 16:38:04.591975 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 16:38:04.591975 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 16:38:04.591975 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ff53b0d-4020-4a1c-8af5-9cd0fbba8e06 could not be found. Sep 09 16:38:04.591975 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Sep 09 16:38:04.594177 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-e002deff-0cf1-4d65-ba40-d55fa753dff2 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Returning 404 to user: Instance 8ff53b0d-4020-4a1c-8af5-9cd0fbba8e06 could not be found. {{(pid=127196) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 16:38:04.594177 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-e002deff-0cf1-4d65-ba40-d55fa753dff2 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] 10.222.0.23 "GET /compute/v2.1/servers/8ff53b0d-4020-4a1c-8af5-9cd0fbba8e06" status: 404 len: 111 microversion: 2.1 time: 0.036229 Sep 09 16:38:04.594177 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 377/753] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:38:04 2022] GET /compute/v2.1/servers/8ff53b0d-4020-4a1c-8af5-9cd0fbba8e06 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 16:38:05.750397 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-7dca2efb-a2a6-4143-95f4-c5fb0c739920 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:38:05.750967 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-7dca2efb-a2a6-4143-95f4-c5fb0c739920 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] [instance: 9e761961-9c74-444c-bb4b-0b2f82a9d698] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:38:05.757534 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7dca2efb-a2a6-4143-95f4-c5fb0c739920 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:05.758015 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7dca2efb-a2a6-4143-95f4-c5fb0c739920 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:05.758442 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7dca2efb-a2a6-4143-95f4-c5fb0c739920 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:05.759166 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7dca2efb-a2a6-4143-95f4-c5fb0c739920 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:05.759618 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7dca2efb-a2a6-4143-95f4-c5fb0c739920 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:05.760425 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7dca2efb-a2a6-4143-95f4-c5fb0c739920 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:05.774326 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.wsgi [None req-7dca2efb-a2a6-4143-95f4-c5fb0c739920 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] HTTP exception thrown: Instance 9e761961-9c74-444c-bb4b-0b2f82a9d698 could not be found. Sep 09 16:38:05.775898 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-7dca2efb-a2a6-4143-95f4-c5fb0c739920 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Request method failure captured: Sep 09 16:38:05.775898 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: request: DELETE /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698 HTTP/1.1 Sep 09 16:38:05.775898 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Accept: application/json Sep 09 16:38:05.775898 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Accept-Encoding: identity Sep 09 16:38:05.775898 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Connection: close Sep 09 16:38:05.775898 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Content-Length: 0 Sep 09 16:38:05.775898 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Content-Type: application/json Sep 09 16:38:05.775898 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Host: 10.222.0.23 Sep 09 16:38:05.775898 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Openstack-System-Scope: None Sep 09 16:38:05.775898 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: User-Agent: python-urllib3/1.26.12 Sep 09 16:38:05.775898 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Auth-Token: gAAAAABjG2p5h27SNGzaEpji7SWrLO5cgdqsF7efiLI2ph1vni7NHoRtUz6NkAUldAhjPwUaWVflxxS46FZgyOUf_zmOAGi-dTPqh7WbuBAnycxGx0udk1PEjoMJv7YQhQ0d8oPz8gs7S9PKaOIRpoyjcGeIgaCRey4yIJ-sI0C9gxuQnuVKgbw Sep 09 16:38:05.775898 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Domain-Id: None Sep 09 16:38:05.775898 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Domain-Name: None Sep 09 16:38:05.775898 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Identity-Status: Confirmed Sep 09 16:38:05.775898 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Is-Admin-Project: True Sep 09 16:38:05.775898 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Project-Domain-Id: default Sep 09 16:38:05.775898 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Project-Domain-Name: Default Sep 09 16:38:05.775898 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Project-Id: f90f2e0c002343d88ae25dc7bfb2fe10 Sep 09 16:38:05.775898 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Project-Name: tempest-AttachVolumeTestJSON-1369004595 Sep 09 16:38:05.775898 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Role: member,reader Sep 09 16:38:05.775898 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Roles: member,reader Sep 09 16:38:05.777527 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f90f2e0c002343d88ae25dc7bfb2fe10"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f90f2e0c002343d88ae25dc7bfb2fe10"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f90f2e0c002343d88ae25dc7bfb2fe10"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f90f2e0c002343d88ae25dc7bfb2fe10"}]}] Sep 09 16:38:05.777527 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Tenant: tempest-AttachVolumeTestJSON-1369004595 Sep 09 16:38:05.777527 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Tenant-Id: f90f2e0c002343d88ae25dc7bfb2fe10 Sep 09 16:38:05.777527 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1369004595 Sep 09 16:38:05.777527 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User: tempest-AttachVolumeTestJSON-1369004595-project Sep 09 16:38:05.777527 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User-Domain-Id: default Sep 09 16:38:05.777527 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User-Domain-Name: Default Sep 09 16:38:05.777527 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User-Id: d095ed814b9e47e08d6b5a4fd2901c43 Sep 09 16:38:05.777527 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User-Name: tempest-AttachVolumeTestJSON-1369004595-project Sep 09 16:38:05.777527 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: method: > Sep 09 16:38:05.777527 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: exception: Instance 9e761961-9c74-444c-bb4b-0b2f82a9d698 could not be found. Sep 09 16:38:05.777527 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: action_args: {'id': '9e761961-9c74-444c-bb4b-0b2f82a9d698'} Sep 09 16:38:05.778618 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 16:38:05.778618 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:38:05.778618 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 16:38:05.778618 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 16:38:05.778618 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 16:38:05.778618 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 16:38:05.778618 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 16:38:05.778618 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 16:38:05.778618 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 16:38:05.778618 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 16:38:05.778618 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e761961-9c74-444c-bb4b-0b2f82a9d698 could not be found. Sep 09 16:38:05.778618 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:38:05.778618 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 16:38:05.778618 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:38:05.778618 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:38:05.778618 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 16:38:05.778618 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 16:38:05.778618 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 16:38:05.778618 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 16:38:05.778618 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 16:38:05.779891 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 16:38:05.779891 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 09 16:38:05.779891 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 09 16:38:05.779891 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 09 16:38:05.779891 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 09 16:38:05.779891 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 16:38:05.779891 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 16:38:05.779891 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 16:38:05.779891 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 16:38:05.779891 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e761961-9c74-444c-bb4b-0b2f82a9d698 could not be found. Sep 09 16:38:05.779891 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:38:05.779891 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 16:38:05.779891 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:38:05.779891 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:38:05.779891 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 16:38:05.779891 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 16:38:05.779891 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 16:38:05.779891 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 16:38:05.779891 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e761961-9c74-444c-bb4b-0b2f82a9d698 could not be found. Sep 09 16:38:05.779891 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:38:05.781100 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-7dca2efb-a2a6-4143-95f4-c5fb0c739920 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Returning 404 to user: Instance 9e761961-9c74-444c-bb4b-0b2f82a9d698 could not be found. {{(pid=127198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 16:38:05.781100 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-7dca2efb-a2a6-4143-95f4-c5fb0c739920 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] 10.222.0.23 "DELETE /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698" status: 404 len: 111 microversion: 2.1 time: 0.030725 Sep 09 16:38:05.781100 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 377/754] 10.222.0.23 () {58 vars in 1239 bytes} [Fri Sep 9 16:38:05 2022] DELETE /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 16:38:05.785845 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-ccf94b36-18dd-463d-927f-65181d59c7e5 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:38:05.786445 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-ccf94b36-18dd-463d-927f-65181d59c7e5 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] [instance: 9e761961-9c74-444c-bb4b-0b2f82a9d698] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:38:05.793279 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-ccf94b36-18dd-463d-927f-65181d59c7e5 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:05.793752 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-ccf94b36-18dd-463d-927f-65181d59c7e5 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:05.794182 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-ccf94b36-18dd-463d-927f-65181d59c7e5 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:05.794890 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-ccf94b36-18dd-463d-927f-65181d59c7e5 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:05.795338 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-ccf94b36-18dd-463d-927f-65181d59c7e5 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:05.795747 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-ccf94b36-18dd-463d-927f-65181d59c7e5 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:05.809126 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.wsgi [None req-ccf94b36-18dd-463d-927f-65181d59c7e5 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] HTTP exception thrown: Instance 9e761961-9c74-444c-bb4b-0b2f82a9d698 could not be found. Sep 09 16:38:05.810697 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-ccf94b36-18dd-463d-927f-65181d59c7e5 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Request method failure captured: Sep 09 16:38:05.810697 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: request: GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698 HTTP/1.1 Sep 09 16:38:05.810697 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Accept: application/json Sep 09 16:38:05.810697 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Accept-Encoding: identity Sep 09 16:38:05.810697 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Connection: close Sep 09 16:38:05.810697 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Content-Length: 0 Sep 09 16:38:05.810697 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Content-Type: application/json Sep 09 16:38:05.810697 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Host: 10.222.0.23 Sep 09 16:38:05.810697 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Openstack-System-Scope: None Sep 09 16:38:05.810697 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: User-Agent: python-urllib3/1.26.12 Sep 09 16:38:05.810697 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Auth-Token: gAAAAABjG2p5h27SNGzaEpji7SWrLO5cgdqsF7efiLI2ph1vni7NHoRtUz6NkAUldAhjPwUaWVflxxS46FZgyOUf_zmOAGi-dTPqh7WbuBAnycxGx0udk1PEjoMJv7YQhQ0d8oPz8gs7S9PKaOIRpoyjcGeIgaCRey4yIJ-sI0C9gxuQnuVKgbw Sep 09 16:38:05.810697 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Domain-Id: None Sep 09 16:38:05.810697 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Domain-Name: None Sep 09 16:38:05.810697 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Identity-Status: Confirmed Sep 09 16:38:05.810697 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Is-Admin-Project: True Sep 09 16:38:05.810697 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Project-Domain-Id: default Sep 09 16:38:05.810697 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Project-Domain-Name: Default Sep 09 16:38:05.810697 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Project-Id: f90f2e0c002343d88ae25dc7bfb2fe10 Sep 09 16:38:05.810697 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Project-Name: tempest-AttachVolumeTestJSON-1369004595 Sep 09 16:38:05.810697 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Role: member,reader Sep 09 16:38:05.810697 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Roles: member,reader Sep 09 16:38:05.812246 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f90f2e0c002343d88ae25dc7bfb2fe10"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f90f2e0c002343d88ae25dc7bfb2fe10"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f90f2e0c002343d88ae25dc7bfb2fe10"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f90f2e0c002343d88ae25dc7bfb2fe10"}]}] Sep 09 16:38:05.812246 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Tenant: tempest-AttachVolumeTestJSON-1369004595 Sep 09 16:38:05.812246 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Tenant-Id: f90f2e0c002343d88ae25dc7bfb2fe10 Sep 09 16:38:05.812246 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1369004595 Sep 09 16:38:05.812246 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-User: tempest-AttachVolumeTestJSON-1369004595-project Sep 09 16:38:05.812246 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-User-Domain-Id: default Sep 09 16:38:05.812246 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-User-Domain-Name: Default Sep 09 16:38:05.812246 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-User-Id: d095ed814b9e47e08d6b5a4fd2901c43 Sep 09 16:38:05.812246 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-User-Name: tempest-AttachVolumeTestJSON-1369004595-project Sep 09 16:38:05.812246 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: method: > Sep 09 16:38:05.812246 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: exception: Instance 9e761961-9c74-444c-bb4b-0b2f82a9d698 could not be found. Sep 09 16:38:05.812246 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: action_args: {'id': '9e761961-9c74-444c-bb4b-0b2f82a9d698'} Sep 09 16:38:05.817097 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 16:38:05.817097 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:38:05.817097 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 16:38:05.817097 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 16:38:05.817097 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 16:38:05.817097 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 16:38:05.817097 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 16:38:05.817097 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 16:38:05.817097 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 16:38:05.817097 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 16:38:05.817097 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e761961-9c74-444c-bb4b-0b2f82a9d698 could not be found. Sep 09 16:38:05.817097 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Sep 09 16:38:05.817097 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 16:38:05.817097 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Sep 09 16:38:05.817097 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:38:05.817097 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 16:38:05.817097 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 16:38:05.817097 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 16:38:05.817097 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 16:38:05.817097 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 16:38:05.818593 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 16:38:05.818593 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 16:38:05.818593 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 16:38:05.818593 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 16:38:05.818593 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 16:38:05.818593 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 16:38:05.818593 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 16:38:05.818593 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e761961-9c74-444c-bb4b-0b2f82a9d698 could not be found. Sep 09 16:38:05.818593 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Sep 09 16:38:05.818593 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 16:38:05.818593 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Sep 09 16:38:05.818593 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:38:05.818593 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 16:38:05.818593 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 16:38:05.818593 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 16:38:05.818593 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 16:38:05.818593 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e761961-9c74-444c-bb4b-0b2f82a9d698 could not be found. Sep 09 16:38:05.818593 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Sep 09 16:38:05.820583 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-ccf94b36-18dd-463d-927f-65181d59c7e5 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] Returning 404 to user: Instance 9e761961-9c74-444c-bb4b-0b2f82a9d698 could not be found. {{(pid=127196) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 16:38:05.820583 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-ccf94b36-18dd-463d-927f-65181d59c7e5 tempest-AttachVolumeTestJSON-1369004595 tempest-AttachVolumeTestJSON-1369004595-project] 10.222.0.23 "GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698" status: 404 len: 111 microversion: 2.1 time: 0.030017 Sep 09 16:38:05.820583 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 378/755] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:38:05 2022] GET /compute/v2.1/servers/9e761961-9c74-444c-bb4b-0b2f82a9d698 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 16:38:07.022849 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-7e2f53f6-f535-4e4b-a0ab-d4860aeff2ca tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:38:07.023476 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-7e2f53f6-f535-4e4b-a0ab-d4860aeff2ca tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] [instance: f511030a-fedd-48ec-9d7e-c1b04ea08bc4] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:38:07.030450 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7e2f53f6-f535-4e4b-a0ab-d4860aeff2ca tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:07.030997 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7e2f53f6-f535-4e4b-a0ab-d4860aeff2ca tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:07.031474 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7e2f53f6-f535-4e4b-a0ab-d4860aeff2ca tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:07.032240 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7e2f53f6-f535-4e4b-a0ab-d4860aeff2ca tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:07.032725 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7e2f53f6-f535-4e4b-a0ab-d4860aeff2ca tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:07.033395 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7e2f53f6-f535-4e4b-a0ab-d4860aeff2ca tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:07.069440 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-7e2f53f6-f535-4e4b-a0ab-d4860aeff2ca tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] 10.222.0.23 "GET /compute/v2.1/servers/f511030a-fedd-48ec-9d7e-c1b04ea08bc4/ips" status: 200 len: 150 microversion: 2.1 time: 0.049327 Sep 09 16:38:07.069440 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 378/756] 10.222.0.23 () {58 vars in 1248 bytes} [Fri Sep 9 16:38:07 2022] GET /compute/v2.1/servers/f511030a-fedd-48ec-9d7e-c1b04ea08bc4/ips => generated 150 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:38:07.415936 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-4d28da24-97bb-46c5-bc14-3d416e8a2737 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:38:07.416550 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-4d28da24-97bb-46c5-bc14-3d416e8a2737 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: e20f4f93-c27e-4971-a495-a3498f2611eb] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:38:07.423671 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-4d28da24-97bb-46c5-bc14-3d416e8a2737 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:07.424224 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-4d28da24-97bb-46c5-bc14-3d416e8a2737 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:07.424719 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-4d28da24-97bb-46c5-bc14-3d416e8a2737 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:07.425597 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-4d28da24-97bb-46c5-bc14-3d416e8a2737 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:07.426046 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-4d28da24-97bb-46c5-bc14-3d416e8a2737 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:07.426464 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-4d28da24-97bb-46c5-bc14-3d416e8a2737 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:07.451090 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-4d28da24-97bb-46c5-bc14-3d416e8a2737 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb/ips" status: 200 len: 151 microversion: 2.20 time: 0.041093 Sep 09 16:38:07.451659 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 379/757] 10.222.0.23 () {60 vars in 1289 bytes} [Fri Sep 9 16:38:07 2022] GET /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb/ips => generated 151 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 16:38:08.456066 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-a61dad8a-6752-415f-9d44-1e89bbbb5a0d tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "35e8ee5e-fd49-4f43-af04-1e22e049cb06"}} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:38:08.458571 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-a61dad8a-6752-415f-9d44-1e89bbbb5a0d tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] [instance: f511030a-fedd-48ec-9d7e-c1b04ea08bc4] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:38:08.470203 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a61dad8a-6752-415f-9d44-1e89bbbb5a0d tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:08.470718 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a61dad8a-6752-415f-9d44-1e89bbbb5a0d tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:08.471343 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a61dad8a-6752-415f-9d44-1e89bbbb5a0d tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:08.472188 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a61dad8a-6752-415f-9d44-1e89bbbb5a0d tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:08.472484 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a61dad8a-6752-415f-9d44-1e89bbbb5a0d tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:08.473181 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a61dad8a-6752-415f-9d44-1e89bbbb5a0d tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:08.785804 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-a61dad8a-6752-415f-9d44-1e89bbbb5a0d tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] 10.222.0.23 "POST /compute/v2.1/servers/f511030a-fedd-48ec-9d7e-c1b04ea08bc4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.333702 Sep 09 16:38:08.786858 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 379/758] 10.222.0.23 () {60 vars in 1323 bytes} [Fri Sep 9 16:38:08 2022] POST /compute/v2.1/servers/f511030a-fedd-48ec-9d7e-c1b04ea08bc4/os-volume_attachments => generated 194 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:38:09.564204 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-8faaf2d8-b658-4ebe-977c-689fb9702ec2 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:38:09.564822 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-8faaf2d8-b658-4ebe-977c-689fb9702ec2 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: e20f4f93-c27e-4971-a495-a3498f2611eb] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:38:09.571728 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-8faaf2d8-b658-4ebe-977c-689fb9702ec2 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:09.572217 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-8faaf2d8-b658-4ebe-977c-689fb9702ec2 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:09.572654 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-8faaf2d8-b658-4ebe-977c-689fb9702ec2 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:09.573519 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-8faaf2d8-b658-4ebe-977c-689fb9702ec2 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:09.573889 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-8faaf2d8-b658-4ebe-977c-689fb9702ec2 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:09.574358 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-8faaf2d8-b658-4ebe-977c-689fb9702ec2 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:09.577058 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG dbcounter [-] [127196] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:38:09.600202 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.objects.instance [None req-8faaf2d8-b658-4ebe-977c-689fb9702ec2 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lazy-loading 'flavor' on Instance uuid e20f4f93-c27e-4971-a495-a3498f2611eb {{(pid=127196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 16:38:09.843953 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-8faaf2d8-b658-4ebe-977c-689fb9702ec2 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "POST /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb/action" status: 202 len: 0 microversion: 2.20 time: 0.283246 Sep 09 16:38:09.844897 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 380/759] 10.222.0.23 () {62 vars in 1319 bytes} [Fri Sep 9 16:38:09 2022] POST /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb/action => generated 0 bytes in 285 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 09 16:38:09.862669 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-f482a605-741c-44e9-a7c3-fb154d41cb10 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:38:09.863137 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-f482a605-741c-44e9-a7c3-fb154d41cb10 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: e20f4f93-c27e-4971-a495-a3498f2611eb] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:38:09.871055 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f482a605-741c-44e9-a7c3-fb154d41cb10 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:09.876143 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f482a605-741c-44e9-a7c3-fb154d41cb10 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:09.876715 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f482a605-741c-44e9-a7c3-fb154d41cb10 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:09.877581 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f482a605-741c-44e9-a7c3-fb154d41cb10 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:09.878051 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f482a605-741c-44e9-a7c3-fb154d41cb10 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:09.878477 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f482a605-741c-44e9-a7c3-fb154d41cb10 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:10.041674 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-f482a605-741c-44e9-a7c3-fb154d41cb10 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:10.051425 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-f482a605-741c-44e9-a7c3-fb154d41cb10 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:10.052754 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-f482a605-741c-44e9-a7c3-fb154d41cb10 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:10.054398 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-f482a605-741c-44e9-a7c3-fb154d41cb10 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb" status: 200 len: 1721 microversion: 2.20 time: 0.205190 Sep 09 16:38:10.055170 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 380/760] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Sep 9 16:38:09 2022] GET /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb => generated 1721 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 16:38:10.891156 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-d08c856a-8d9a-4593-bff4-1e8eb8908560 tempest-VolumesSnapshotsTestJSON-1456655625 tempest-VolumesSnapshotsTestJSON-1456655625-project] Action: 'create', calling method: .version_select at 0x7f24fb620430>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1884824613"}} {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:38:11.083046 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-562a0b27-0ad0-42d5-8479-acb1a24dbc0a tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:38:11.084395 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-562a0b27-0ad0-42d5-8479-acb1a24dbc0a tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: e20f4f93-c27e-4971-a495-a3498f2611eb] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:38:11.094427 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-562a0b27-0ad0-42d5-8479-acb1a24dbc0a tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:11.094955 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-562a0b27-0ad0-42d5-8479-acb1a24dbc0a tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:11.095392 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-562a0b27-0ad0-42d5-8479-acb1a24dbc0a tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:11.096292 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-562a0b27-0ad0-42d5-8479-acb1a24dbc0a tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:11.096757 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-562a0b27-0ad0-42d5-8479-acb1a24dbc0a tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:11.097182 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-562a0b27-0ad0-42d5-8479-acb1a24dbc0a tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:11.199692 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-d08c856a-8d9a-4593-bff4-1e8eb8908560 tempest-VolumesSnapshotsTestJSON-1456655625 tempest-VolumesSnapshotsTestJSON-1456655625-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.537755 Sep 09 16:38:11.205828 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 381/761] 10.222.0.23 () {60 vars in 1155 bytes} [Fri Sep 9 16:38:10 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 545 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 09 16:38:11.213509 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-6b2c5ec1-eff2-4fb4-ac1c-f2b64473cb53 tempest-VolumesSnapshotsTestJSON-1456655625 tempest-VolumesSnapshotsTestJSON-1456655625-project] Calling method '.version_select at 0x7f24fb4b7670>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:38:11.272064 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-6b2c5ec1-eff2-4fb4-ac1c-f2b64473cb53 tempest-VolumesSnapshotsTestJSON-1456655625 tempest-VolumesSnapshotsTestJSON-1456655625-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/cb5f5d98-fb6b-478f-9428-ea7ca3da292a" status: 200 len: 345 microversion: 2.1 time: 0.062068 Sep 09 16:38:11.279673 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 382/762] 10.222.0.23 () {58 vars in 1245 bytes} [Fri Sep 9 16:38:11 2022] GET /compute/v2.1/os-volumes/cb5f5d98-fb6b-478f-9428-ea7ca3da292a => generated 345 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:38:11.280780 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-562a0b27-0ad0-42d5-8479-acb1a24dbc0a tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:11.289644 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-562a0b27-0ad0-42d5-8479-acb1a24dbc0a tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:11.291142 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-562a0b27-0ad0-42d5-8479-acb1a24dbc0a tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:11.292538 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-562a0b27-0ad0-42d5-8479-acb1a24dbc0a tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb" status: 200 len: 1721 microversion: 2.20 time: 0.216237 Sep 09 16:38:11.293268 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 381/763] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Sep 9 16:38:11 2022] GET /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb => generated 1721 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 16:38:12.287593 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-2e2097b9-e9e8-4762-9d19-aeee1294b141 tempest-VolumesSnapshotsTestJSON-1456655625 tempest-VolumesSnapshotsTestJSON-1456655625-project] Calling method '.version_select at 0x7f24fb522550>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:38:12.317973 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-a9a19c7d-ee39-4ba4-b697-7d8ee2ddee41 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:38:12.318592 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-a9a19c7d-ee39-4ba4-b697-7d8ee2ddee41 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: e20f4f93-c27e-4971-a495-a3498f2611eb] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:38:12.325528 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a9a19c7d-ee39-4ba4-b697-7d8ee2ddee41 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:12.326180 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a9a19c7d-ee39-4ba4-b697-7d8ee2ddee41 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:12.326785 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a9a19c7d-ee39-4ba4-b697-7d8ee2ddee41 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:12.327656 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a9a19c7d-ee39-4ba4-b697-7d8ee2ddee41 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:12.328527 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a9a19c7d-ee39-4ba4-b697-7d8ee2ddee41 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:12.329134 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a9a19c7d-ee39-4ba4-b697-7d8ee2ddee41 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:12.338450 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-2e2097b9-e9e8-4762-9d19-aeee1294b141 tempest-VolumesSnapshotsTestJSON-1456655625 tempest-VolumesSnapshotsTestJSON-1456655625-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/cb5f5d98-fb6b-478f-9428-ea7ca3da292a" status: 200 len: 346 microversion: 2.1 time: 0.055057 Sep 09 16:38:12.339056 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 383/764] 10.222.0.23 () {58 vars in 1245 bytes} [Fri Sep 9 16:38:12 2022] GET /compute/v2.1/os-volumes/cb5f5d98-fb6b-478f-9428-ea7ca3da292a => generated 346 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:38:12.352719 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-2167c171-a4c5-4d7f-9205-e8553211309e tempest-VolumesSnapshotsTestJSON-1456655625 tempest-VolumesSnapshotsTestJSON-1456655625-project] Action: 'create', calling method: .version_select at 0x7f24fb6200d0>, body: {"snapshot": {"volume_id": "cb5f5d98-fb6b-478f-9428-ea7ca3da292a", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-146744344"}} {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:38:12.477690 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-a9a19c7d-ee39-4ba4-b697-7d8ee2ddee41 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:12.487589 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-a9a19c7d-ee39-4ba4-b697-7d8ee2ddee41 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:12.489030 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-a9a19c7d-ee39-4ba4-b697-7d8ee2ddee41 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:12.490203 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-a9a19c7d-ee39-4ba4-b697-7d8ee2ddee41 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb" status: 200 len: 1721 microversion: 2.20 time: 0.176342 Sep 09 16:38:12.490931 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 382/765] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Sep 9 16:38:12 2022] GET /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb => generated 1721 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 16:38:12.529400 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-2167c171-a4c5-4d7f-9205-e8553211309e tempest-VolumesSnapshotsTestJSON-1456655625 tempest-VolumesSnapshotsTestJSON-1456655625-project] 10.222.0.23 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.180720 Sep 09 16:38:12.530280 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 384/766] 10.222.0.23 () {60 vars in 1162 bytes} [Fri Sep 9 16:38:12 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:38:12.541841 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-d55c4813-85dd-4728-8bde-656b60ad57f0 tempest-VolumesSnapshotsTestJSON-1456655625 tempest-VolumesSnapshotsTestJSON-1456655625-project] Calling method '.version_select at 0x7f24fb4e0e50>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:38:12.573249 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-d55c4813-85dd-4728-8bde-656b60ad57f0 tempest-VolumesSnapshotsTestJSON-1456655625 tempest-VolumesSnapshotsTestJSON-1456655625-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/5aa7bdfc-c4b6-4866-8e29-fd42982fd206" status: 200 len: 286 microversion: 2.1 time: 0.035980 Sep 09 16:38:12.573850 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 383/767] 10.222.0.23 () {58 vars in 1251 bytes} [Fri Sep 9 16:38:12 2022] GET /compute/v2.1/os-snapshots/5aa7bdfc-c4b6-4866-8e29-fd42982fd206 => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:38:12.586713 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-1e253f06-ead6-47c4-b922-c768afbed496 tempest-VolumesSnapshotsTestJSON-1456655625 tempest-VolumesSnapshotsTestJSON-1456655625-project] Calling method '.version_select at 0x7f24fb55f310>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:38:12.619290 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-1e253f06-ead6-47c4-b922-c768afbed496 tempest-VolumesSnapshotsTestJSON-1456655625 tempest-VolumesSnapshotsTestJSON-1456655625-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.036369 Sep 09 16:38:12.619897 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 385/768] 10.222.0.23 () {58 vars in 1140 bytes} [Fri Sep 9 16:38:12 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:38:12.631044 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-059e920d-3da2-4df7-95ad-8bc291d0c136 tempest-VolumesSnapshotsTestJSON-1456655625 tempest-VolumesSnapshotsTestJSON-1456655625-project] Calling method '.version_select at 0x7f24fb509f70>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:38:12.665774 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-059e920d-3da2-4df7-95ad-8bc291d0c136 tempest-VolumesSnapshotsTestJSON-1456655625 tempest-VolumesSnapshotsTestJSON-1456655625-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/5aa7bdfc-c4b6-4866-8e29-fd42982fd206" status: 200 len: 286 microversion: 2.1 time: 0.038555 Sep 09 16:38:12.666342 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 384/769] 10.222.0.23 () {58 vars in 1251 bytes} [Fri Sep 9 16:38:12 2022] GET /compute/v2.1/os-snapshots/5aa7bdfc-c4b6-4866-8e29-fd42982fd206 => generated 286 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:38:13.516267 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-64f62851-52c2-41b6-8698-37120d05d341 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:38:13.517077 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-64f62851-52c2-41b6-8698-37120d05d341 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: e20f4f93-c27e-4971-a495-a3498f2611eb] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:38:13.523652 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-64f62851-52c2-41b6-8698-37120d05d341 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:13.524224 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-64f62851-52c2-41b6-8698-37120d05d341 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:13.524743 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-64f62851-52c2-41b6-8698-37120d05d341 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:13.525503 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-64f62851-52c2-41b6-8698-37120d05d341 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:13.526076 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-64f62851-52c2-41b6-8698-37120d05d341 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:13.526746 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-64f62851-52c2-41b6-8698-37120d05d341 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:13.662015 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-64f62851-52c2-41b6-8698-37120d05d341 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:13.670548 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-64f62851-52c2-41b6-8698-37120d05d341 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:13.671998 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-64f62851-52c2-41b6-8698-37120d05d341 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:13.673153 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-64f62851-52c2-41b6-8698-37120d05d341 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb" status: 200 len: 1721 microversion: 2.20 time: 0.161553 Sep 09 16:38:13.674169 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 386/770] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Sep 9 16:38:13 2022] GET /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 16:38:13.679628 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-6c70f476-e338-45f4-a1d0-72dddf523611 tempest-VolumesSnapshotsTestJSON-1456655625 tempest-VolumesSnapshotsTestJSON-1456655625-project] Calling method '.version_select at 0x7f24fb43b790>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:38:13.710279 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-6c70f476-e338-45f4-a1d0-72dddf523611 tempest-VolumesSnapshotsTestJSON-1456655625 tempest-VolumesSnapshotsTestJSON-1456655625-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/5aa7bdfc-c4b6-4866-8e29-fd42982fd206" status: 200 len: 286 microversion: 2.1 time: 0.035429 Sep 09 16:38:13.710880 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 385/771] 10.222.0.23 () {58 vars in 1251 bytes} [Fri Sep 9 16:38:13 2022] GET /compute/v2.1/os-snapshots/5aa7bdfc-c4b6-4866-8e29-fd42982fd206 => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 16:38:14.703804 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-bfed62d4-d40f-41ad-b572-327e20db3a90 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:38:14.704763 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-bfed62d4-d40f-41ad-b572-327e20db3a90 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: e20f4f93-c27e-4971-a495-a3498f2611eb] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:38:14.715387 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-bfed62d4-d40f-41ad-b572-327e20db3a90 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:14.716181 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-bfed62d4-d40f-41ad-b572-327e20db3a90 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:14.716896 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-bfed62d4-d40f-41ad-b572-327e20db3a90 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:14.718568 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-bfed62d4-d40f-41ad-b572-327e20db3a90 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:14.719378 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-bfed62d4-d40f-41ad-b572-327e20db3a90 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:14.720408 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-bfed62d4-d40f-41ad-b572-327e20db3a90 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:14.726811 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-2cda0bff-cf5d-4ca0-8f02-d88d10b38c32 tempest-VolumesSnapshotsTestJSON-1456655625 tempest-VolumesSnapshotsTestJSON-1456655625-project] Calling method '.version_select at 0x7f24fb4e08b0>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:38:14.756327 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-2cda0bff-cf5d-4ca0-8f02-d88d10b38c32 tempest-VolumesSnapshotsTestJSON-1456655625 tempest-VolumesSnapshotsTestJSON-1456655625-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/5aa7bdfc-c4b6-4866-8e29-fd42982fd206" status: 200 len: 286 microversion: 2.1 time: 0.036434 Sep 09 16:38:14.757026 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 386/772] 10.222.0.23 () {58 vars in 1251 bytes} [Fri Sep 9 16:38:14 2022] GET /compute/v2.1/os-snapshots/5aa7bdfc-c4b6-4866-8e29-fd42982fd206 => generated 286 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 16:38:14.860024 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-bfed62d4-d40f-41ad-b572-327e20db3a90 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:14.870658 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-bfed62d4-d40f-41ad-b572-327e20db3a90 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:14.872107 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-bfed62d4-d40f-41ad-b572-327e20db3a90 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:14.873263 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-bfed62d4-d40f-41ad-b572-327e20db3a90 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb" status: 200 len: 1721 microversion: 2.20 time: 0.176392 Sep 09 16:38:14.873803 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 387/773] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Sep 9 16:38:14 2022] GET /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb => generated 1721 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 16:38:15.773519 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-0e466300-a377-40ee-96e5-419b7c09879b tempest-VolumesSnapshotsTestJSON-1456655625 tempest-VolumesSnapshotsTestJSON-1456655625-project] Calling method '.version_select at 0x7f24fb511a60>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:38:15.813024 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-0e466300-a377-40ee-96e5-419b7c09879b tempest-VolumesSnapshotsTestJSON-1456655625 tempest-VolumesSnapshotsTestJSON-1456655625-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/5aa7bdfc-c4b6-4866-8e29-fd42982fd206" status: 200 len: 287 microversion: 2.1 time: 0.046788 Sep 09 16:38:15.813574 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 387/774] 10.222.0.23 () {58 vars in 1251 bytes} [Fri Sep 9 16:38:15 2022] GET /compute/v2.1/os-snapshots/5aa7bdfc-c4b6-4866-8e29-fd42982fd206 => generated 287 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:38:15.834786 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-360db60f-e6a9-48bf-9a17-bd266e206bd9 tempest-VolumesSnapshotsTestJSON-1456655625 tempest-VolumesSnapshotsTestJSON-1456655625-project] Calling method '.version_select at 0x7f24fb509b80>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:38:15.897805 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-a05130ef-d33e-4898-9fb1-ce35f79e4013 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:38:15.898418 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-a05130ef-d33e-4898-9fb1-ce35f79e4013 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: e20f4f93-c27e-4971-a495-a3498f2611eb] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:38:15.901273 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-360db60f-e6a9-48bf-9a17-bd266e206bd9 tempest-VolumesSnapshotsTestJSON-1456655625 tempest-VolumesSnapshotsTestJSON-1456655625-project] 10.222.0.23 "DELETE /compute/v2.1/os-snapshots/5aa7bdfc-c4b6-4866-8e29-fd42982fd206" status: 202 len: 0 microversion: 2.1 time: 0.078548 Sep 09 16:38:15.901888 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 388/775] 10.222.0.23 () {58 vars in 1254 bytes} [Fri Sep 9 16:38:15 2022] DELETE /compute/v2.1/os-snapshots/5aa7bdfc-c4b6-4866-8e29-fd42982fd206 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 16:38:15.905973 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a05130ef-d33e-4898-9fb1-ce35f79e4013 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:15.906374 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a05130ef-d33e-4898-9fb1-ce35f79e4013 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:15.906831 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a05130ef-d33e-4898-9fb1-ce35f79e4013 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:15.907521 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a05130ef-d33e-4898-9fb1-ce35f79e4013 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:15.907965 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a05130ef-d33e-4898-9fb1-ce35f79e4013 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:15.908380 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a05130ef-d33e-4898-9fb1-ce35f79e4013 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:15.910046 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-ef1e1c2c-59ac-46b5-bf1f-d84abc0fd499 tempest-VolumesSnapshotsTestJSON-1456655625 tempest-VolumesSnapshotsTestJSON-1456655625-project] Calling method '.version_select at 0x7f24fb4b7ca0>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:38:15.928070 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:38:15.940871 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-ef1e1c2c-59ac-46b5-bf1f-d84abc0fd499 tempest-VolumesSnapshotsTestJSON-1456655625 tempest-VolumesSnapshotsTestJSON-1456655625-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/5aa7bdfc-c4b6-4866-8e29-fd42982fd206" status: 200 len: 286 microversion: 2.1 time: 0.034573 Sep 09 16:38:15.941445 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 389/776] 10.222.0.23 () {58 vars in 1251 bytes} [Fri Sep 9 16:38:15 2022] GET /compute/v2.1/os-snapshots/5aa7bdfc-c4b6-4866-8e29-fd42982fd206 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:38:16.072879 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-a05130ef-d33e-4898-9fb1-ce35f79e4013 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:16.082980 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-a05130ef-d33e-4898-9fb1-ce35f79e4013 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:16.088157 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-a05130ef-d33e-4898-9fb1-ce35f79e4013 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:16.089449 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-a05130ef-d33e-4898-9fb1-ce35f79e4013 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb" status: 200 len: 1721 microversion: 2.20 time: 0.195687 Sep 09 16:38:16.090321 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 388/777] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Sep 9 16:38:15 2022] GET /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb => generated 1721 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 16:38:16.517660 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-35dbcba9-3421-4478-93eb-32c8f119ca38 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:38:16.518182 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-35dbcba9-3421-4478-93eb-32c8f119ca38 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] [instance: f511030a-fedd-48ec-9d7e-c1b04ea08bc4] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:38:16.525182 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-35dbcba9-3421-4478-93eb-32c8f119ca38 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:16.525656 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-35dbcba9-3421-4478-93eb-32c8f119ca38 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:16.526096 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-35dbcba9-3421-4478-93eb-32c8f119ca38 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:16.526823 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-35dbcba9-3421-4478-93eb-32c8f119ca38 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:16.527287 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-35dbcba9-3421-4478-93eb-32c8f119ca38 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:16.527710 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-35dbcba9-3421-4478-93eb-32c8f119ca38 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:16.619069 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.objects.instance [None req-35dbcba9-3421-4478-93eb-32c8f119ca38 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lazy-loading 'services' on Instance uuid f511030a-fedd-48ec-9d7e-c1b04ea08bc4 {{(pid=127196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 16:38:16.699634 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-35dbcba9-3421-4478-93eb-32c8f119ca38 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] 10.222.0.23 "DELETE /compute/v2.1/servers/f511030a-fedd-48ec-9d7e-c1b04ea08bc4/os-volume_attachments/35e8ee5e-fd49-4f43-af04-1e22e049cb06" status: 202 len: 0 microversion: 2.1 time: 0.185778 Sep 09 16:38:16.700152 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 390/778] 10.222.0.23 () {58 vars in 1416 bytes} [Fri Sep 9 16:38:16 2022] DELETE /compute/v2.1/servers/f511030a-fedd-48ec-9d7e-c1b04ea08bc4/os-volume_attachments/35e8ee5e-fd49-4f43-af04-1e22e049cb06 => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 16:38:16.708843 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-9e1bc1e9-5d8a-4190-9b58-85c92e2b18ef tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:38:16.711146 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-9e1bc1e9-5d8a-4190-9b58-85c92e2b18ef tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] [instance: f511030a-fedd-48ec-9d7e-c1b04ea08bc4] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:38:16.717501 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9e1bc1e9-5d8a-4190-9b58-85c92e2b18ef tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:16.717988 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9e1bc1e9-5d8a-4190-9b58-85c92e2b18ef tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:16.718425 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9e1bc1e9-5d8a-4190-9b58-85c92e2b18ef tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:16.719301 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9e1bc1e9-5d8a-4190-9b58-85c92e2b18ef tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:16.719750 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9e1bc1e9-5d8a-4190-9b58-85c92e2b18ef tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:16.720225 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9e1bc1e9-5d8a-4190-9b58-85c92e2b18ef tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:16.750336 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-9e1bc1e9-5d8a-4190-9b58-85c92e2b18ef tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] 10.222.0.23 "GET /compute/v2.1/servers/f511030a-fedd-48ec-9d7e-c1b04ea08bc4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045479 Sep 09 16:38:16.750920 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 389/779] 10.222.0.23 () {58 vars in 1302 bytes} [Fri Sep 9 16:38:16 2022] GET /compute/v2.1/servers/f511030a-fedd-48ec-9d7e-c1b04ea08bc4/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:38:16.960088 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-8cc5907c-b344-4c83-81b2-59cf50245950 tempest-VolumesSnapshotsTestJSON-1456655625 tempest-VolumesSnapshotsTestJSON-1456655625-project] Calling method '.version_select at 0x7f24fb4bb820>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:38:16.993091 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.wsgi [None req-8cc5907c-b344-4c83-81b2-59cf50245950 tempest-VolumesSnapshotsTestJSON-1456655625 tempest-VolumesSnapshotsTestJSON-1456655625-project] HTTP exception thrown: Snapshot 5aa7bdfc-c4b6-4866-8e29-fd42982fd206 could not be found. Sep 09 16:38:16.995416 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-8cc5907c-b344-4c83-81b2-59cf50245950 tempest-VolumesSnapshotsTestJSON-1456655625 tempest-VolumesSnapshotsTestJSON-1456655625-project] Request method failure captured: Sep 09 16:38:16.995416 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: request: GET /compute/v2.1/os-snapshots/5aa7bdfc-c4b6-4866-8e29-fd42982fd206 HTTP/1.1 Sep 09 16:38:16.995416 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Accept: application/json Sep 09 16:38:16.995416 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Accept-Encoding: identity Sep 09 16:38:16.995416 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Connection: close Sep 09 16:38:16.995416 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Content-Length: 0 Sep 09 16:38:16.995416 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Content-Type: application/json Sep 09 16:38:16.995416 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Host: 10.222.0.23 Sep 09 16:38:16.995416 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Openstack-System-Scope: None Sep 09 16:38:16.995416 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: User-Agent: python-urllib3/1.26.12 Sep 09 16:38:16.995416 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Auth-Token: gAAAAABjG2vyENSFbnzet6ACgwIKCJy-uIKxboXjovif9S4YYyYqbMCbCfY50aHGIXwh_MDClxCt138O9EpVu8hu0H_aWE1zEcBCnxk_y51p-d_rH6WY9HQ3HJSYe7C1mTUDp4v9jaYF2DRDVOPaWGMYKqgzODcrlH9bstgL4Ayf4cg4-C0ex9Y Sep 09 16:38:16.995416 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Domain-Id: None Sep 09 16:38:16.995416 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Domain-Name: None Sep 09 16:38:16.995416 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Identity-Status: Confirmed Sep 09 16:38:16.995416 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Is-Admin-Project: True Sep 09 16:38:16.995416 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Project-Domain-Id: default Sep 09 16:38:16.995416 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Project-Domain-Name: Default Sep 09 16:38:16.995416 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Project-Id: e093d600ea0f484093caac4acb2c78d5 Sep 09 16:38:16.995416 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1456655625 Sep 09 16:38:16.995416 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Role: member,reader Sep 09 16:38:16.995416 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Roles: member,reader Sep 09 16:38:16.996968 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e093d600ea0f484093caac4acb2c78d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e093d600ea0f484093caac4acb2c78d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e093d600ea0f484093caac4acb2c78d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e093d600ea0f484093caac4acb2c78d5"}]}] Sep 09 16:38:16.996968 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1456655625 Sep 09 16:38:16.996968 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Tenant-Id: e093d600ea0f484093caac4acb2c78d5 Sep 09 16:38:16.996968 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1456655625 Sep 09 16:38:16.996968 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-User: tempest-VolumesSnapshotsTestJSON-1456655625-project Sep 09 16:38:16.996968 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-User-Domain-Id: default Sep 09 16:38:16.996968 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-User-Domain-Name: Default Sep 09 16:38:16.996968 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-User-Id: ddfaf643f3974784b7405975046c13d1 Sep 09 16:38:16.996968 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1456655625-project Sep 09 16:38:16.996968 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: method: Sep 09 16:38:16.996968 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: exception: Snapshot 5aa7bdfc-c4b6-4866-8e29-fd42982fd206 could not be found. Sep 09 16:38:16.996968 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: action_args: {'id': '5aa7bdfc-c4b6-4866-8e29-fd42982fd206'} Sep 09 16:38:16.996968 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 16:38:16.998153 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:38:16.998153 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 09 16:38:16.998153 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 09 16:38:16.998153 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 09 16:38:16.998153 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 09 16:38:16.998153 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 09 16:38:16.998153 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 09 16:38:16.998153 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 09 16:38:16.998153 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 09 16:38:16.998153 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 09 16:38:16.998153 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 09 16:38:16.998153 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 16:38:16.998153 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 16:38:16.998153 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 16:38:16.998153 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 16:38:16.998153 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 5aa7bdfc-c4b6-4866-8e29-fd42982fd206 could not be found. (HTTP 404) (Request-ID: req-6fee3951-e2e5-40a7-ade9-f0f252f278ef) Sep 09 16:38:16.998153 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Sep 09 16:38:16.998153 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 16:38:16.999544 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Sep 09 16:38:16.999544 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:38:16.999544 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 09 16:38:16.999544 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 09 16:38:16.999544 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 09 16:38:16.999544 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 09 16:38:16.999544 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 09 16:38:16.999544 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 09 16:38:16.999544 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 09 16:38:16.999544 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 09 16:38:16.999544 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 09 16:38:16.999544 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 09 16:38:16.999544 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 09 16:38:16.999544 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 09 16:38:16.999544 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 09 16:38:16.999544 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 09 16:38:16.999544 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 09 16:38:16.999544 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 09 16:38:16.999544 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 09 16:38:17.000988 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 09 16:38:17.000988 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 16:38:17.000988 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 16:38:17.000988 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 16:38:17.000988 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 16:38:17.000988 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 5aa7bdfc-c4b6-4866-8e29-fd42982fd206 could not be found. Sep 09 16:38:17.000988 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Sep 09 16:38:17.000988 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 16:38:17.000988 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Sep 09 16:38:17.000988 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:38:17.000988 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 16:38:17.000988 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 16:38:17.000988 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 16:38:17.000988 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 16:38:17.000988 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 16:38:17.000988 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 16:38:17.000988 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 16:38:17.000988 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 16:38:17.000988 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 09 16:38:17.000988 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 16:38:17.002457 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 5aa7bdfc-c4b6-4866-8e29-fd42982fd206 could not be found. Sep 09 16:38:17.002457 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Sep 09 16:38:17.002457 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 16:38:17.002457 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Sep 09 16:38:17.002457 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:38:17.002457 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 16:38:17.002457 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 16:38:17.002457 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 16:38:17.002457 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 16:38:17.002457 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 5aa7bdfc-c4b6-4866-8e29-fd42982fd206 could not be found. Sep 09 16:38:17.002457 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Sep 09 16:38:17.002457 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-8cc5907c-b344-4c83-81b2-59cf50245950 tempest-VolumesSnapshotsTestJSON-1456655625 tempest-VolumesSnapshotsTestJSON-1456655625-project] Returning 404 to user: Snapshot 5aa7bdfc-c4b6-4866-8e29-fd42982fd206 could not be found. {{(pid=127196) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 16:38:17.002457 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-8cc5907c-b344-4c83-81b2-59cf50245950 tempest-VolumesSnapshotsTestJSON-1456655625 tempest-VolumesSnapshotsTestJSON-1456655625-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/5aa7bdfc-c4b6-4866-8e29-fd42982fd206" status: 404 len: 111 microversion: 2.1 time: 0.044941 Sep 09 16:38:17.003444 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 391/780] 10.222.0.23 () {58 vars in 1251 bytes} [Fri Sep 9 16:38:16 2022] GET /compute/v2.1/os-snapshots/5aa7bdfc-c4b6-4866-8e29-fd42982fd206 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 16:38:17.005810 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-a691bfa5-cad3-40db-b392-3e010e5862ce tempest-VolumesSnapshotsTestJSON-1456655625 tempest-VolumesSnapshotsTestJSON-1456655625-project] Calling method '.version_select at 0x7f24fb558670>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:38:17.072187 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-a691bfa5-cad3-40db-b392-3e010e5862ce tempest-VolumesSnapshotsTestJSON-1456655625 tempest-VolumesSnapshotsTestJSON-1456655625-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/cb5f5d98-fb6b-478f-9428-ea7ca3da292a" status: 202 len: 0 microversion: 2.1 time: 0.070229 Sep 09 16:38:17.072761 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 390/781] 10.222.0.23 () {58 vars in 1248 bytes} [Fri Sep 9 16:38:17 2022] DELETE /compute/v2.1/os-volumes/cb5f5d98-fb6b-478f-9428-ea7ca3da292a => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 16:38:17.081379 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-73f4565b-b0f6-41ee-8d37-96cae73c4bd1 tempest-VolumesSnapshotsTestJSON-1456655625 tempest-VolumesSnapshotsTestJSON-1456655625-project] Calling method '.version_select at 0x7f24fb609310>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:38:17.115936 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-3904a45a-2aaf-43e0-989b-84b133d9788f tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:38:17.116548 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-3904a45a-2aaf-43e0-989b-84b133d9788f tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: e20f4f93-c27e-4971-a495-a3498f2611eb] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:38:17.122775 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3904a45a-2aaf-43e0-989b-84b133d9788f tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:17.123260 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3904a45a-2aaf-43e0-989b-84b133d9788f tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:17.123696 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3904a45a-2aaf-43e0-989b-84b133d9788f tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:17.124389 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3904a45a-2aaf-43e0-989b-84b133d9788f tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:17.124839 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3904a45a-2aaf-43e0-989b-84b133d9788f tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:17.125447 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3904a45a-2aaf-43e0-989b-84b133d9788f tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:17.131270 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-73f4565b-b0f6-41ee-8d37-96cae73c4bd1 tempest-VolumesSnapshotsTestJSON-1456655625 tempest-VolumesSnapshotsTestJSON-1456655625-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/cb5f5d98-fb6b-478f-9428-ea7ca3da292a" status: 200 len: 345 microversion: 2.1 time: 0.053747 Sep 09 16:38:17.131837 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 392/782] 10.222.0.23 () {58 vars in 1245 bytes} [Fri Sep 9 16:38:17 2022] GET /compute/v2.1/os-volumes/cb5f5d98-fb6b-478f-9428-ea7ca3da292a => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:38:17.265690 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-3904a45a-2aaf-43e0-989b-84b133d9788f tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:17.274107 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-3904a45a-2aaf-43e0-989b-84b133d9788f tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:17.275726 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-3904a45a-2aaf-43e0-989b-84b133d9788f tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:17.277007 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-3904a45a-2aaf-43e0-989b-84b133d9788f tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb" status: 200 len: 1721 microversion: 2.20 time: 0.164965 Sep 09 16:38:17.277904 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 391/783] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Sep 9 16:38:17 2022] GET /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 16:38:17.763264 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-5156d35c-ff7e-4fd6-b59b-e39a38c8fa32 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:38:17.765631 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-5156d35c-ff7e-4fd6-b59b-e39a38c8fa32 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] [instance: f511030a-fedd-48ec-9d7e-c1b04ea08bc4] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:38:17.772124 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-5156d35c-ff7e-4fd6-b59b-e39a38c8fa32 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:17.772618 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-5156d35c-ff7e-4fd6-b59b-e39a38c8fa32 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:17.773041 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-5156d35c-ff7e-4fd6-b59b-e39a38c8fa32 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:17.773735 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-5156d35c-ff7e-4fd6-b59b-e39a38c8fa32 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:17.774176 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-5156d35c-ff7e-4fd6-b59b-e39a38c8fa32 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:17.774639 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-5156d35c-ff7e-4fd6-b59b-e39a38c8fa32 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:17.805386 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-5156d35c-ff7e-4fd6-b59b-e39a38c8fa32 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] 10.222.0.23 "GET /compute/v2.1/servers/f511030a-fedd-48ec-9d7e-c1b04ea08bc4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046247 Sep 09 16:38:17.806022 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 393/784] 10.222.0.23 () {58 vars in 1302 bytes} [Fri Sep 9 16:38:17 2022] GET /compute/v2.1/servers/f511030a-fedd-48ec-9d7e-c1b04ea08bc4/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 09 16:38:17.876514 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-17234255-1eea-4636-aee8-d90aa580ab85 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:38:17.876514 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-17234255-1eea-4636-aee8-d90aa580ab85 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] [instance: f511030a-fedd-48ec-9d7e-c1b04ea08bc4] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:38:17.882367 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-17234255-1eea-4636-aee8-d90aa580ab85 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:17.882972 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-17234255-1eea-4636-aee8-d90aa580ab85 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:17.883467 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-17234255-1eea-4636-aee8-d90aa580ab85 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:17.884337 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-17234255-1eea-4636-aee8-d90aa580ab85 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:17.884797 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-17234255-1eea-4636-aee8-d90aa580ab85 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:17.885202 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-17234255-1eea-4636-aee8-d90aa580ab85 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:17.911827 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-17234255-1eea-4636-aee8-d90aa580ab85 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] [instance: f511030a-fedd-48ec-9d7e-c1b04ea08bc4] Going to try to terminate instance {{(pid=127198) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 16:38:18.005908 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-17234255-1eea-4636-aee8-d90aa580ab85 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] 10.222.0.23 "DELETE /compute/v2.1/servers/f511030a-fedd-48ec-9d7e-c1b04ea08bc4" status: 204 len: 0 microversion: 2.1 time: 0.134061 Sep 09 16:38:18.007347 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 392/785] 10.222.0.23 () {58 vars in 1239 bytes} [Fri Sep 9 16:38:17 2022] DELETE /compute/v2.1/servers/f511030a-fedd-48ec-9d7e-c1b04ea08bc4 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 16:38:18.015788 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-f4161d72-29a3-4752-a915-535d2cc04dcd tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:38:18.016734 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-f4161d72-29a3-4752-a915-535d2cc04dcd tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] [instance: f511030a-fedd-48ec-9d7e-c1b04ea08bc4] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:38:18.023232 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f4161d72-29a3-4752-a915-535d2cc04dcd tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:18.023782 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f4161d72-29a3-4752-a915-535d2cc04dcd tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:18.024303 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f4161d72-29a3-4752-a915-535d2cc04dcd tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:18.025111 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f4161d72-29a3-4752-a915-535d2cc04dcd tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:18.025657 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f4161d72-29a3-4752-a915-535d2cc04dcd tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:18.026052 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f4161d72-29a3-4752-a915-535d2cc04dcd tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:18.146076 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-357adac3-88de-428b-b701-d500d7d1311b tempest-VolumesSnapshotsTestJSON-1456655625 tempest-VolumesSnapshotsTestJSON-1456655625-project] Calling method '.version_select at 0x7f24fb558a60>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:38:18.165844 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-f4161d72-29a3-4752-a915-535d2cc04dcd tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c0721dc18343b18993ff5af098841d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17967a941be4a04bbc180e2cf3a7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:18.173548 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-f4161d72-29a3-4752-a915-535d2cc04dcd tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] 10.222.0.23 "GET /compute/v2.1/servers/f511030a-fedd-48ec-9d7e-c1b04ea08bc4" status: 200 len: 1680 microversion: 2.1 time: 0.161653 Sep 09 16:38:18.174648 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 394/786] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:38:18 2022] GET /compute/v2.1/servers/f511030a-fedd-48ec-9d7e-c1b04ea08bc4 => generated 1680 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:38:18.180700 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.wsgi [None req-357adac3-88de-428b-b701-d500d7d1311b tempest-VolumesSnapshotsTestJSON-1456655625 tempest-VolumesSnapshotsTestJSON-1456655625-project] HTTP exception thrown: Volume cb5f5d98-fb6b-478f-9428-ea7ca3da292a could not be found. Sep 09 16:38:18.182873 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-357adac3-88de-428b-b701-d500d7d1311b tempest-VolumesSnapshotsTestJSON-1456655625 tempest-VolumesSnapshotsTestJSON-1456655625-project] Request method failure captured: Sep 09 16:38:18.182873 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: request: GET /compute/v2.1/os-volumes/cb5f5d98-fb6b-478f-9428-ea7ca3da292a HTTP/1.1 Sep 09 16:38:18.182873 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Accept: application/json Sep 09 16:38:18.182873 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Accept-Encoding: identity Sep 09 16:38:18.182873 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Connection: close Sep 09 16:38:18.182873 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Content-Length: 0 Sep 09 16:38:18.182873 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Content-Type: application/json Sep 09 16:38:18.182873 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Host: 10.222.0.23 Sep 09 16:38:18.182873 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Openstack-System-Scope: None Sep 09 16:38:18.182873 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: User-Agent: python-urllib3/1.26.12 Sep 09 16:38:18.182873 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Auth-Token: gAAAAABjG2vyENSFbnzet6ACgwIKCJy-uIKxboXjovif9S4YYyYqbMCbCfY50aHGIXwh_MDClxCt138O9EpVu8hu0H_aWE1zEcBCnxk_y51p-d_rH6WY9HQ3HJSYe7C1mTUDp4v9jaYF2DRDVOPaWGMYKqgzODcrlH9bstgL4Ayf4cg4-C0ex9Y Sep 09 16:38:18.182873 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Domain-Id: None Sep 09 16:38:18.182873 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Domain-Name: None Sep 09 16:38:18.182873 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Identity-Status: Confirmed Sep 09 16:38:18.182873 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Is-Admin-Project: True Sep 09 16:38:18.182873 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Project-Domain-Id: default Sep 09 16:38:18.182873 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Project-Domain-Name: Default Sep 09 16:38:18.182873 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Project-Id: e093d600ea0f484093caac4acb2c78d5 Sep 09 16:38:18.182873 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1456655625 Sep 09 16:38:18.182873 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Role: member,reader Sep 09 16:38:18.182873 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Roles: member,reader Sep 09 16:38:18.184454 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e093d600ea0f484093caac4acb2c78d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e093d600ea0f484093caac4acb2c78d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e093d600ea0f484093caac4acb2c78d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e093d600ea0f484093caac4acb2c78d5"}]}] Sep 09 16:38:18.184454 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1456655625 Sep 09 16:38:18.184454 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Tenant-Id: e093d600ea0f484093caac4acb2c78d5 Sep 09 16:38:18.184454 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1456655625 Sep 09 16:38:18.184454 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User: tempest-VolumesSnapshotsTestJSON-1456655625-project Sep 09 16:38:18.184454 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User-Domain-Id: default Sep 09 16:38:18.184454 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User-Domain-Name: Default Sep 09 16:38:18.184454 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User-Id: ddfaf643f3974784b7405975046c13d1 Sep 09 16:38:18.184454 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1456655625-project Sep 09 16:38:18.184454 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: method: Sep 09 16:38:18.184454 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: exception: Volume cb5f5d98-fb6b-478f-9428-ea7ca3da292a could not be found. Sep 09 16:38:18.184454 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: action_args: {'id': 'cb5f5d98-fb6b-478f-9428-ea7ca3da292a'} Sep 09 16:38:18.184454 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 16:38:18.185439 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:38:18.185439 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 16:38:18.185439 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 16:38:18.185439 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 09 16:38:18.185439 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 09 16:38:18.185439 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 09 16:38:18.185439 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 09 16:38:18.185439 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 09 16:38:18.185439 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 09 16:38:18.185439 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 09 16:38:18.185439 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 09 16:38:18.185439 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 16:38:18.185439 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 16:38:18.185439 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 16:38:18.185439 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 16:38:18.185439 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume cb5f5d98-fb6b-478f-9428-ea7ca3da292a could not be found. (HTTP 404) (Request-ID: req-555aeedf-52fd-48e9-8a23-654d298a398b) Sep 09 16:38:18.185439 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:38:18.185439 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 16:38:18.185439 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:38:18.188566 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:38:18.188566 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 09 16:38:18.188566 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 09 16:38:18.188566 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 09 16:38:18.188566 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 09 16:38:18.188566 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 09 16:38:18.188566 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 09 16:38:18.188566 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 09 16:38:18.188566 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 09 16:38:18.188566 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 16:38:18.188566 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 16:38:18.188566 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 09 16:38:18.188566 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 09 16:38:18.188566 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 09 16:38:18.188566 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 09 16:38:18.188566 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 09 16:38:18.188566 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 09 16:38:18.188566 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 09 16:38:18.188566 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 09 16:38:18.189827 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 16:38:18.189827 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 16:38:18.189827 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 16:38:18.189827 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 16:38:18.189827 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume cb5f5d98-fb6b-478f-9428-ea7ca3da292a could not be found. Sep 09 16:38:18.189827 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:38:18.189827 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 16:38:18.189827 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:38:18.189827 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:38:18.189827 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 16:38:18.189827 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 16:38:18.189827 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 16:38:18.189827 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 16:38:18.189827 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 16:38:18.189827 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 16:38:18.189827 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 16:38:18.189827 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 16:38:18.189827 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 09 16:38:18.189827 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 16:38:18.191981 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume cb5f5d98-fb6b-478f-9428-ea7ca3da292a could not be found. Sep 09 16:38:18.191981 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:38:18.191981 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 16:38:18.191981 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:38:18.191981 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:38:18.191981 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 16:38:18.191981 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 16:38:18.191981 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 16:38:18.191981 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 16:38:18.191981 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume cb5f5d98-fb6b-478f-9428-ea7ca3da292a could not be found. Sep 09 16:38:18.191981 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:38:18.191981 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-357adac3-88de-428b-b701-d500d7d1311b tempest-VolumesSnapshotsTestJSON-1456655625 tempest-VolumesSnapshotsTestJSON-1456655625-project] Returning 404 to user: Volume cb5f5d98-fb6b-478f-9428-ea7ca3da292a could not be found. {{(pid=127198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 16:38:18.191981 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-357adac3-88de-428b-b701-d500d7d1311b tempest-VolumesSnapshotsTestJSON-1456655625 tempest-VolumesSnapshotsTestJSON-1456655625-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/cb5f5d98-fb6b-478f-9428-ea7ca3da292a" status: 404 len: 109 microversion: 2.1 time: 0.042649 Sep 09 16:38:18.194779 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 393/787] 10.222.0.23 () {58 vars in 1245 bytes} [Fri Sep 9 16:38:18 2022] GET /compute/v2.1/os-volumes/cb5f5d98-fb6b-478f-9428-ea7ca3da292a => generated 109 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 09 16:38:18.202950 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-8b12ab91-e373-49c1-aaa1-a0518fd862ab tempest-VolumesSnapshotsTestJSON-1456655625 tempest-VolumesSnapshotsTestJSON-1456655625-project] Calling method '.version_select at 0x7f24fb4bbca0>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:38:18.231234 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.wsgi [None req-8b12ab91-e373-49c1-aaa1-a0518fd862ab tempest-VolumesSnapshotsTestJSON-1456655625 tempest-VolumesSnapshotsTestJSON-1456655625-project] HTTP exception thrown: Volume cb5f5d98-fb6b-478f-9428-ea7ca3da292a could not be found. Sep 09 16:38:18.233160 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-8b12ab91-e373-49c1-aaa1-a0518fd862ab tempest-VolumesSnapshotsTestJSON-1456655625 tempest-VolumesSnapshotsTestJSON-1456655625-project] Request method failure captured: Sep 09 16:38:18.233160 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: request: DELETE /compute/v2.1/os-volumes/cb5f5d98-fb6b-478f-9428-ea7ca3da292a HTTP/1.1 Sep 09 16:38:18.233160 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Accept: application/json Sep 09 16:38:18.233160 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Accept-Encoding: identity Sep 09 16:38:18.233160 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Connection: close Sep 09 16:38:18.233160 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Content-Length: 0 Sep 09 16:38:18.233160 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Content-Type: application/json Sep 09 16:38:18.233160 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Host: 10.222.0.23 Sep 09 16:38:18.233160 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Openstack-System-Scope: None Sep 09 16:38:18.233160 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: User-Agent: python-urllib3/1.26.12 Sep 09 16:38:18.233160 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Auth-Token: gAAAAABjG2vyENSFbnzet6ACgwIKCJy-uIKxboXjovif9S4YYyYqbMCbCfY50aHGIXwh_MDClxCt138O9EpVu8hu0H_aWE1zEcBCnxk_y51p-d_rH6WY9HQ3HJSYe7C1mTUDp4v9jaYF2DRDVOPaWGMYKqgzODcrlH9bstgL4Ayf4cg4-C0ex9Y Sep 09 16:38:18.233160 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Domain-Id: None Sep 09 16:38:18.233160 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Domain-Name: None Sep 09 16:38:18.233160 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Identity-Status: Confirmed Sep 09 16:38:18.233160 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Is-Admin-Project: True Sep 09 16:38:18.233160 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Project-Domain-Id: default Sep 09 16:38:18.233160 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Project-Domain-Name: Default Sep 09 16:38:18.233160 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Project-Id: e093d600ea0f484093caac4acb2c78d5 Sep 09 16:38:18.233160 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1456655625 Sep 09 16:38:18.233160 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Role: member,reader Sep 09 16:38:18.233160 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Roles: member,reader Sep 09 16:38:18.234806 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e093d600ea0f484093caac4acb2c78d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e093d600ea0f484093caac4acb2c78d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e093d600ea0f484093caac4acb2c78d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e093d600ea0f484093caac4acb2c78d5"}]}] Sep 09 16:38:18.234806 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1456655625 Sep 09 16:38:18.234806 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Tenant-Id: e093d600ea0f484093caac4acb2c78d5 Sep 09 16:38:18.234806 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1456655625 Sep 09 16:38:18.234806 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-User: tempest-VolumesSnapshotsTestJSON-1456655625-project Sep 09 16:38:18.234806 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-User-Domain-Id: default Sep 09 16:38:18.234806 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-User-Domain-Name: Default Sep 09 16:38:18.234806 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-User-Id: ddfaf643f3974784b7405975046c13d1 Sep 09 16:38:18.234806 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1456655625-project Sep 09 16:38:18.234806 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: method: Sep 09 16:38:18.234806 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: exception: Volume cb5f5d98-fb6b-478f-9428-ea7ca3da292a could not be found. Sep 09 16:38:18.234806 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: action_args: {'id': 'cb5f5d98-fb6b-478f-9428-ea7ca3da292a'} Sep 09 16:38:18.234806 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 16:38:18.235875 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:38:18.235875 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 16:38:18.235875 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 16:38:18.235875 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 09 16:38:18.235875 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 09 16:38:18.235875 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 09 16:38:18.235875 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 09 16:38:18.235875 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 09 16:38:18.235875 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 09 16:38:18.235875 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 09 16:38:18.235875 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 09 16:38:18.235875 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 16:38:18.235875 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 16:38:18.235875 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 16:38:18.235875 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 16:38:18.235875 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume cb5f5d98-fb6b-478f-9428-ea7ca3da292a could not be found. (HTTP 404) (Request-ID: req-f574246a-8238-47d6-97b4-8a389a479fcf) Sep 09 16:38:18.235875 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Sep 09 16:38:18.235875 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 16:38:18.235875 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Sep 09 16:38:18.237269 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:38:18.237269 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 09 16:38:18.237269 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 09 16:38:18.237269 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 09 16:38:18.237269 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 09 16:38:18.237269 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 09 16:38:18.237269 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 09 16:38:18.237269 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 09 16:38:18.237269 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 09 16:38:18.237269 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 16:38:18.237269 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 16:38:18.237269 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 09 16:38:18.237269 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 09 16:38:18.237269 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 09 16:38:18.237269 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 09 16:38:18.237269 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 09 16:38:18.237269 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 09 16:38:18.237269 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 09 16:38:18.237269 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 09 16:38:18.238624 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 16:38:18.238624 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 16:38:18.238624 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 16:38:18.238624 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 16:38:18.238624 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume cb5f5d98-fb6b-478f-9428-ea7ca3da292a could not be found. Sep 09 16:38:18.238624 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Sep 09 16:38:18.238624 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 16:38:18.238624 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Sep 09 16:38:18.238624 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:38:18.238624 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 16:38:18.238624 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 16:38:18.238624 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 16:38:18.238624 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 16:38:18.238624 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 16:38:18.238624 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 16:38:18.238624 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 16:38:18.238624 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 16:38:18.238624 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 09 16:38:18.238624 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 16:38:18.240274 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume cb5f5d98-fb6b-478f-9428-ea7ca3da292a could not be found. Sep 09 16:38:18.240274 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Sep 09 16:38:18.240274 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 16:38:18.240274 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Sep 09 16:38:18.240274 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:38:18.240274 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 16:38:18.240274 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 16:38:18.240274 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 16:38:18.240274 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 16:38:18.240274 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume cb5f5d98-fb6b-478f-9428-ea7ca3da292a could not be found. Sep 09 16:38:18.240274 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Sep 09 16:38:18.240274 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-8b12ab91-e373-49c1-aaa1-a0518fd862ab tempest-VolumesSnapshotsTestJSON-1456655625 tempest-VolumesSnapshotsTestJSON-1456655625-project] Returning 404 to user: Volume cb5f5d98-fb6b-478f-9428-ea7ca3da292a could not be found. {{(pid=127196) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 16:38:18.240274 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-8b12ab91-e373-49c1-aaa1-a0518fd862ab tempest-VolumesSnapshotsTestJSON-1456655625 tempest-VolumesSnapshotsTestJSON-1456655625-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/cb5f5d98-fb6b-478f-9428-ea7ca3da292a" status: 404 len: 109 microversion: 2.1 time: 0.038981 Sep 09 16:38:18.240274 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 395/788] 10.222.0.23 () {58 vars in 1248 bytes} [Fri Sep 9 16:38:18 2022] DELETE /compute/v2.1/os-volumes/cb5f5d98-fb6b-478f-9428-ea7ca3da292a => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 09 16:38:18.243121 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-bf0079c5-9892-4fa2-962c-856f1ccd9c12 tempest-VolumesSnapshotsTestJSON-1456655625 tempest-VolumesSnapshotsTestJSON-1456655625-project] Calling method '.version_select at 0x7f24fb4be310>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:38:18.275128 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.wsgi [None req-bf0079c5-9892-4fa2-962c-856f1ccd9c12 tempest-VolumesSnapshotsTestJSON-1456655625 tempest-VolumesSnapshotsTestJSON-1456655625-project] HTTP exception thrown: Volume cb5f5d98-fb6b-478f-9428-ea7ca3da292a could not be found. Sep 09 16:38:18.277278 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-bf0079c5-9892-4fa2-962c-856f1ccd9c12 tempest-VolumesSnapshotsTestJSON-1456655625 tempest-VolumesSnapshotsTestJSON-1456655625-project] Request method failure captured: Sep 09 16:38:18.277278 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: request: GET /compute/v2.1/os-volumes/cb5f5d98-fb6b-478f-9428-ea7ca3da292a HTTP/1.1 Sep 09 16:38:18.277278 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Accept: application/json Sep 09 16:38:18.277278 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Accept-Encoding: identity Sep 09 16:38:18.277278 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Connection: close Sep 09 16:38:18.277278 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Content-Length: 0 Sep 09 16:38:18.277278 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Content-Type: application/json Sep 09 16:38:18.277278 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Host: 10.222.0.23 Sep 09 16:38:18.277278 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Openstack-System-Scope: None Sep 09 16:38:18.277278 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: User-Agent: python-urllib3/1.26.12 Sep 09 16:38:18.277278 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Auth-Token: gAAAAABjG2vyENSFbnzet6ACgwIKCJy-uIKxboXjovif9S4YYyYqbMCbCfY50aHGIXwh_MDClxCt138O9EpVu8hu0H_aWE1zEcBCnxk_y51p-d_rH6WY9HQ3HJSYe7C1mTUDp4v9jaYF2DRDVOPaWGMYKqgzODcrlH9bstgL4Ayf4cg4-C0ex9Y Sep 09 16:38:18.277278 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Domain-Id: None Sep 09 16:38:18.277278 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Domain-Name: None Sep 09 16:38:18.277278 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Identity-Status: Confirmed Sep 09 16:38:18.277278 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Is-Admin-Project: True Sep 09 16:38:18.277278 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Project-Domain-Id: default Sep 09 16:38:18.277278 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Project-Domain-Name: Default Sep 09 16:38:18.277278 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Project-Id: e093d600ea0f484093caac4acb2c78d5 Sep 09 16:38:18.277278 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1456655625 Sep 09 16:38:18.277278 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Role: member,reader Sep 09 16:38:18.277278 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Roles: member,reader Sep 09 16:38:18.278869 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e093d600ea0f484093caac4acb2c78d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e093d600ea0f484093caac4acb2c78d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e093d600ea0f484093caac4acb2c78d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e093d600ea0f484093caac4acb2c78d5"}]}] Sep 09 16:38:18.278869 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1456655625 Sep 09 16:38:18.278869 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Tenant-Id: e093d600ea0f484093caac4acb2c78d5 Sep 09 16:38:18.278869 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1456655625 Sep 09 16:38:18.278869 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User: tempest-VolumesSnapshotsTestJSON-1456655625-project Sep 09 16:38:18.278869 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User-Domain-Id: default Sep 09 16:38:18.278869 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User-Domain-Name: Default Sep 09 16:38:18.278869 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User-Id: ddfaf643f3974784b7405975046c13d1 Sep 09 16:38:18.278869 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1456655625-project Sep 09 16:38:18.278869 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: method: Sep 09 16:38:18.278869 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: exception: Volume cb5f5d98-fb6b-478f-9428-ea7ca3da292a could not be found. Sep 09 16:38:18.278869 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: action_args: {'id': 'cb5f5d98-fb6b-478f-9428-ea7ca3da292a'} Sep 09 16:38:18.278869 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 16:38:18.280095 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:38:18.280095 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 16:38:18.280095 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 16:38:18.280095 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 09 16:38:18.280095 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 09 16:38:18.280095 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 09 16:38:18.280095 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 09 16:38:18.280095 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 09 16:38:18.280095 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 09 16:38:18.280095 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 09 16:38:18.280095 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 09 16:38:18.280095 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 16:38:18.280095 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 16:38:18.280095 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 16:38:18.280095 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 16:38:18.280095 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume cb5f5d98-fb6b-478f-9428-ea7ca3da292a could not be found. (HTTP 404) (Request-ID: req-1fd57adc-6f07-49ed-81b8-550a36562eda) Sep 09 16:38:18.280095 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:38:18.280095 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 16:38:18.280095 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:38:18.281630 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:38:18.281630 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 09 16:38:18.281630 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 09 16:38:18.281630 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 09 16:38:18.281630 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 09 16:38:18.281630 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 09 16:38:18.281630 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 09 16:38:18.281630 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 09 16:38:18.281630 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 09 16:38:18.281630 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 16:38:18.281630 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 16:38:18.281630 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 09 16:38:18.281630 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 09 16:38:18.281630 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 09 16:38:18.281630 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 09 16:38:18.281630 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 09 16:38:18.281630 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 09 16:38:18.281630 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 09 16:38:18.281630 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 09 16:38:18.283268 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 16:38:18.283268 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 16:38:18.283268 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 16:38:18.283268 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 16:38:18.283268 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume cb5f5d98-fb6b-478f-9428-ea7ca3da292a could not be found. Sep 09 16:38:18.283268 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:38:18.283268 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 16:38:18.283268 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:38:18.283268 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:38:18.283268 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 16:38:18.283268 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 16:38:18.283268 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 16:38:18.283268 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 16:38:18.283268 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 16:38:18.283268 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 16:38:18.283268 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 16:38:18.283268 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 16:38:18.283268 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 09 16:38:18.283268 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 16:38:18.284635 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume cb5f5d98-fb6b-478f-9428-ea7ca3da292a could not be found. Sep 09 16:38:18.284635 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:38:18.284635 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 16:38:18.284635 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:38:18.284635 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:38:18.284635 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 16:38:18.284635 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 16:38:18.284635 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 16:38:18.284635 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 16:38:18.284635 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume cb5f5d98-fb6b-478f-9428-ea7ca3da292a could not be found. Sep 09 16:38:18.284635 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:38:18.284635 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-bf0079c5-9892-4fa2-962c-856f1ccd9c12 tempest-VolumesSnapshotsTestJSON-1456655625 tempest-VolumesSnapshotsTestJSON-1456655625-project] Returning 404 to user: Volume cb5f5d98-fb6b-478f-9428-ea7ca3da292a could not be found. {{(pid=127198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 16:38:18.284635 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-bf0079c5-9892-4fa2-962c-856f1ccd9c12 tempest-VolumesSnapshotsTestJSON-1456655625 tempest-VolumesSnapshotsTestJSON-1456655625-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/cb5f5d98-fb6b-478f-9428-ea7ca3da292a" status: 404 len: 109 microversion: 2.1 time: 0.039343 Sep 09 16:38:18.284635 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 394/789] 10.222.0.23 () {58 vars in 1245 bytes} [Fri Sep 9 16:38:18 2022] GET /compute/v2.1/os-volumes/cb5f5d98-fb6b-478f-9428-ea7ca3da292a => generated 109 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 16:38:18.305131 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-33a1146a-41b0-429a-b303-1abfda8d3945 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:38:18.306121 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-33a1146a-41b0-429a-b303-1abfda8d3945 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: e20f4f93-c27e-4971-a495-a3498f2611eb] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:38:18.316844 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-33a1146a-41b0-429a-b303-1abfda8d3945 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:18.317747 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-33a1146a-41b0-429a-b303-1abfda8d3945 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:18.318220 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-33a1146a-41b0-429a-b303-1abfda8d3945 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:18.319004 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-33a1146a-41b0-429a-b303-1abfda8d3945 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:18.319527 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-33a1146a-41b0-429a-b303-1abfda8d3945 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:18.320025 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-33a1146a-41b0-429a-b303-1abfda8d3945 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:18.455627 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-33a1146a-41b0-429a-b303-1abfda8d3945 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:18.464812 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-33a1146a-41b0-429a-b303-1abfda8d3945 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:18.466286 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-33a1146a-41b0-429a-b303-1abfda8d3945 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:18.467542 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-33a1146a-41b0-429a-b303-1abfda8d3945 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb" status: 200 len: 1721 microversion: 2.20 time: 0.168066 Sep 09 16:38:18.468133 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 396/790] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Sep 9 16:38:18 2022] GET /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb => generated 1721 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 16:38:19.198404 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-0b8d1414-24e1-4c49-aac7-2cb134e63b3d tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:38:19.199178 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-0b8d1414-24e1-4c49-aac7-2cb134e63b3d tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] [instance: f511030a-fedd-48ec-9d7e-c1b04ea08bc4] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:38:19.205691 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0b8d1414-24e1-4c49-aac7-2cb134e63b3d tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:19.206227 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0b8d1414-24e1-4c49-aac7-2cb134e63b3d tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:19.206694 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0b8d1414-24e1-4c49-aac7-2cb134e63b3d tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:19.207380 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0b8d1414-24e1-4c49-aac7-2cb134e63b3d tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:19.208151 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0b8d1414-24e1-4c49-aac7-2cb134e63b3d tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:19.208785 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0b8d1414-24e1-4c49-aac7-2cb134e63b3d tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:19.348390 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-0b8d1414-24e1-4c49-aac7-2cb134e63b3d tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c0721dc18343b18993ff5af098841d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17967a941be4a04bbc180e2cf3a7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:19.358177 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-0b8d1414-24e1-4c49-aac7-2cb134e63b3d tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] 10.222.0.23 "GET /compute/v2.1/servers/f511030a-fedd-48ec-9d7e-c1b04ea08bc4" status: 200 len: 1680 microversion: 2.1 time: 0.163956 Sep 09 16:38:19.358976 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 395/791] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:38:19 2022] GET /compute/v2.1/servers/f511030a-fedd-48ec-9d7e-c1b04ea08bc4 => generated 1680 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:38:19.494805 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-bc5229ef-aa73-4c48-98f4-27b6642dc684 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:38:19.495406 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-bc5229ef-aa73-4c48-98f4-27b6642dc684 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: e20f4f93-c27e-4971-a495-a3498f2611eb] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:38:19.505942 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-bc5229ef-aa73-4c48-98f4-27b6642dc684 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:19.505942 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-bc5229ef-aa73-4c48-98f4-27b6642dc684 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:19.505942 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-bc5229ef-aa73-4c48-98f4-27b6642dc684 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:19.505942 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-bc5229ef-aa73-4c48-98f4-27b6642dc684 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:19.506314 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-bc5229ef-aa73-4c48-98f4-27b6642dc684 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:19.509041 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-bc5229ef-aa73-4c48-98f4-27b6642dc684 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:19.690535 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-bc5229ef-aa73-4c48-98f4-27b6642dc684 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:19.706414 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-bc5229ef-aa73-4c48-98f4-27b6642dc684 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:19.708346 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-bc5229ef-aa73-4c48-98f4-27b6642dc684 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:19.709652 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-bc5229ef-aa73-4c48-98f4-27b6642dc684 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb" status: 200 len: 1721 microversion: 2.20 time: 0.219771 Sep 09 16:38:19.710792 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 397/792] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Sep 9 16:38:19 2022] GET /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb => generated 1721 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 16:38:20.382237 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-b9603723-386e-457b-8799-d624f0400beb tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:38:20.382887 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-b9603723-386e-457b-8799-d624f0400beb tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] [instance: f511030a-fedd-48ec-9d7e-c1b04ea08bc4] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:38:20.388992 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:38:20.393057 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b9603723-386e-457b-8799-d624f0400beb tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:20.393386 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b9603723-386e-457b-8799-d624f0400beb tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:20.393840 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b9603723-386e-457b-8799-d624f0400beb tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:20.394537 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b9603723-386e-457b-8799-d624f0400beb tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:20.394999 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b9603723-386e-457b-8799-d624f0400beb tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:20.395414 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b9603723-386e-457b-8799-d624f0400beb tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:20.479549 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-b9603723-386e-457b-8799-d624f0400beb tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c0721dc18343b18993ff5af098841d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17967a941be4a04bbc180e2cf3a7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:20.490685 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-b9603723-386e-457b-8799-d624f0400beb tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] 10.222.0.23 "GET /compute/v2.1/servers/f511030a-fedd-48ec-9d7e-c1b04ea08bc4" status: 200 len: 1613 microversion: 2.1 time: 0.112149 Sep 09 16:38:20.499307 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 396/793] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:38:20 2022] GET /compute/v2.1/servers/f511030a-fedd-48ec-9d7e-c1b04ea08bc4 => generated 1613 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:38:20.744280 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-8623678e-8def-4980-989f-d69c591e1b52 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:38:20.744885 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-8623678e-8def-4980-989f-d69c591e1b52 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: e20f4f93-c27e-4971-a495-a3498f2611eb] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:38:20.757893 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8623678e-8def-4980-989f-d69c591e1b52 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:20.758309 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8623678e-8def-4980-989f-d69c591e1b52 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:20.758772 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8623678e-8def-4980-989f-d69c591e1b52 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:20.759754 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8623678e-8def-4980-989f-d69c591e1b52 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:20.760365 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8623678e-8def-4980-989f-d69c591e1b52 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:20.760984 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8623678e-8def-4980-989f-d69c591e1b52 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:20.772097 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [req-c9c072d5-63ea-45f2-8715-a130ed050b2d req-a7d1f082-2c73-48d7-9660-2347b4946564 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f511030a-fedd-48ec-9d7e-c1b04ea08bc4", "name": "network-vif-deleted", "tag": "7662be08-e4ae-4f9d-96b8-1d3efec3f6c1"}]} {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:38:20.777547 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG dbcounter [-] [127196] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:38:20.784287 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [req-c9c072d5-63ea-45f2-8715-a130ed050b2d req-a7d1f082-2c73-48d7-9660-2347b4946564 service nova] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:20.785074 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [req-c9c072d5-63ea-45f2-8715-a130ed050b2d req-a7d1f082-2c73-48d7-9660-2347b4946564 service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:20.786209 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [req-c9c072d5-63ea-45f2-8715-a130ed050b2d req-a7d1f082-2c73-48d7-9660-2347b4946564 service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:20.802403 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.compute.server_external_events [req-c9c072d5-63ea-45f2-8715-a130ed050b2d req-a7d1f082-2c73-48d7-9660-2347b4946564 service nova] Creating event network-vif-deleted:7662be08-e4ae-4f9d-96b8-1d3efec3f6c1 for instance f511030a-fedd-48ec-9d7e-c1b04ea08bc4 on hv-cinder-83124 Sep 09 16:38:20.809941 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [req-c9c072d5-63ea-45f2-8715-a130ed050b2d req-a7d1f082-2c73-48d7-9660-2347b4946564 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.288395 Sep 09 16:38:20.810888 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 398/794] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Sep 9 16:38:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 16:38:20.931022 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-8623678e-8def-4980-989f-d69c591e1b52 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:20.944727 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-8623678e-8def-4980-989f-d69c591e1b52 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:20.946188 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-8623678e-8def-4980-989f-d69c591e1b52 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:20.947454 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-8623678e-8def-4980-989f-d69c591e1b52 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb" status: 200 len: 1721 microversion: 2.20 time: 0.213240 Sep 09 16:38:20.948989 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 397/795] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Sep 9 16:38:20 2022] GET /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb => generated 1721 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 16:38:21.516269 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-f424c8ae-974d-48ee-ad1a-b691a0d6ca56 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:38:21.516975 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-f424c8ae-974d-48ee-ad1a-b691a0d6ca56 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] [instance: f511030a-fedd-48ec-9d7e-c1b04ea08bc4] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:38:21.527027 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f424c8ae-974d-48ee-ad1a-b691a0d6ca56 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:21.527652 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f424c8ae-974d-48ee-ad1a-b691a0d6ca56 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:21.528022 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f424c8ae-974d-48ee-ad1a-b691a0d6ca56 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:21.529124 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f424c8ae-974d-48ee-ad1a-b691a0d6ca56 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:21.529676 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f424c8ae-974d-48ee-ad1a-b691a0d6ca56 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:21.530166 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f424c8ae-974d-48ee-ad1a-b691a0d6ca56 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:21.549407 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.wsgi [None req-f424c8ae-974d-48ee-ad1a-b691a0d6ca56 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] HTTP exception thrown: Instance f511030a-fedd-48ec-9d7e-c1b04ea08bc4 could not be found. Sep 09 16:38:21.551451 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-f424c8ae-974d-48ee-ad1a-b691a0d6ca56 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Request method failure captured: Sep 09 16:38:21.551451 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: request: GET /compute/v2.1/servers/f511030a-fedd-48ec-9d7e-c1b04ea08bc4 HTTP/1.1 Sep 09 16:38:21.551451 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Accept: application/json Sep 09 16:38:21.551451 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Accept-Encoding: identity Sep 09 16:38:21.551451 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Connection: close Sep 09 16:38:21.551451 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Content-Length: 0 Sep 09 16:38:21.551451 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Content-Type: application/json Sep 09 16:38:21.551451 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Host: 10.222.0.23 Sep 09 16:38:21.551451 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Openstack-System-Scope: None Sep 09 16:38:21.551451 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: User-Agent: python-urllib3/1.26.12 Sep 09 16:38:21.551451 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Auth-Token: gAAAAABjG2p8X7ru_JB5hJR44VQ2gJJ5-pnimmT3rRqiF7PaDSUV6TptFJkJ5B7Brlh3RUo94RsnCU-lX7lENCapIWQjRtP9b5hcyxC2h1lMkUs_mIUD6GO84yl6hoSKhKDmYwez2Ale62nt_G9YgAJhsj7sSTM8MyBYvPk9Cs4OYzLEWXRgGoo Sep 09 16:38:21.551451 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Domain-Id: None Sep 09 16:38:21.551451 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Domain-Name: None Sep 09 16:38:21.551451 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Identity-Status: Confirmed Sep 09 16:38:21.551451 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Is-Admin-Project: True Sep 09 16:38:21.551451 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Project-Domain-Id: default Sep 09 16:38:21.551451 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Project-Domain-Name: Default Sep 09 16:38:21.551451 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Project-Id: e17967a941be4a04bbc180e2cf3a7a55 Sep 09 16:38:21.551451 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Project-Name: tempest-AttachVolumeNegativeTest-456905727 Sep 09 16:38:21.551451 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Role: member,reader Sep 09 16:38:21.551451 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Roles: member,reader Sep 09 16:38:21.552848 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e17967a941be4a04bbc180e2cf3a7a55"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e17967a941be4a04bbc180e2cf3a7a55"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e17967a941be4a04bbc180e2cf3a7a55"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e17967a941be4a04bbc180e2cf3a7a55"}]}] Sep 09 16:38:21.552848 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Tenant: tempest-AttachVolumeNegativeTest-456905727 Sep 09 16:38:21.552848 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Tenant-Id: e17967a941be4a04bbc180e2cf3a7a55 Sep 09 16:38:21.552848 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-456905727 Sep 09 16:38:21.552848 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-User: tempest-AttachVolumeNegativeTest-456905727-project Sep 09 16:38:21.552848 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-User-Domain-Id: default Sep 09 16:38:21.552848 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-User-Domain-Name: Default Sep 09 16:38:21.552848 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-User-Id: 53c0721dc18343b18993ff5af098841d Sep 09 16:38:21.552848 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-User-Name: tempest-AttachVolumeNegativeTest-456905727-project Sep 09 16:38:21.552848 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: method: > Sep 09 16:38:21.552848 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: exception: Instance f511030a-fedd-48ec-9d7e-c1b04ea08bc4 could not be found. Sep 09 16:38:21.552848 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: action_args: {'id': 'f511030a-fedd-48ec-9d7e-c1b04ea08bc4'} Sep 09 16:38:21.553605 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 16:38:21.553605 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:38:21.553605 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 16:38:21.553605 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 16:38:21.553605 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 16:38:21.553605 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 16:38:21.553605 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 16:38:21.553605 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 16:38:21.553605 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 16:38:21.553605 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 16:38:21.553605 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f511030a-fedd-48ec-9d7e-c1b04ea08bc4 could not be found. Sep 09 16:38:21.553605 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Sep 09 16:38:21.553605 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 16:38:21.553605 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Sep 09 16:38:21.553605 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:38:21.553605 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 16:38:21.553605 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 16:38:21.553605 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 16:38:21.553605 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 16:38:21.553605 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 16:38:21.554864 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 16:38:21.554864 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 16:38:21.554864 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 16:38:21.554864 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 16:38:21.554864 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 16:38:21.554864 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 16:38:21.554864 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 16:38:21.554864 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f511030a-fedd-48ec-9d7e-c1b04ea08bc4 could not be found. Sep 09 16:38:21.554864 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Sep 09 16:38:21.554864 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 16:38:21.554864 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Sep 09 16:38:21.554864 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:38:21.554864 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 16:38:21.554864 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 16:38:21.554864 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 16:38:21.554864 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 16:38:21.554864 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f511030a-fedd-48ec-9d7e-c1b04ea08bc4 could not be found. Sep 09 16:38:21.554864 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Sep 09 16:38:21.556742 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-f424c8ae-974d-48ee-ad1a-b691a0d6ca56 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Returning 404 to user: Instance f511030a-fedd-48ec-9d7e-c1b04ea08bc4 could not be found. {{(pid=127196) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 16:38:21.556742 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-f424c8ae-974d-48ee-ad1a-b691a0d6ca56 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] 10.222.0.23 "GET /compute/v2.1/servers/f511030a-fedd-48ec-9d7e-c1b04ea08bc4" status: 404 len: 111 microversion: 2.1 time: 0.042039 Sep 09 16:38:21.556742 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 399/796] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:38:21 2022] GET /compute/v2.1/servers/f511030a-fedd-48ec-9d7e-c1b04ea08bc4 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 09 16:38:21.562366 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-9371566b-1fba-4ba3-870e-8753fefc1823 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Calling method '.version_select at 0x7f24fb4beaf0>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:38:21.583566 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-9371566b-1fba-4ba3-870e-8753fefc1823 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-86085779" status: 202 len: 0 microversion: 2.1 time: 0.025124 Sep 09 16:38:21.584158 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 398/797] 10.222.0.23 () {58 vars in 1215 bytes} [Fri Sep 9 16:38:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-86085779 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 16:38:21.973185 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-5223ceda-235d-4620-b544-60fec603b4a7 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:38:21.974576 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-5223ceda-235d-4620-b544-60fec603b4a7 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: e20f4f93-c27e-4971-a495-a3498f2611eb] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:38:21.981356 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-5223ceda-235d-4620-b544-60fec603b4a7 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:21.981922 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-5223ceda-235d-4620-b544-60fec603b4a7 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:21.982411 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-5223ceda-235d-4620-b544-60fec603b4a7 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:21.983178 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-5223ceda-235d-4620-b544-60fec603b4a7 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:21.983847 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-5223ceda-235d-4620-b544-60fec603b4a7 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:21.984263 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-5223ceda-235d-4620-b544-60fec603b4a7 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:22.143971 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-5223ceda-235d-4620-b544-60fec603b4a7 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:22.156675 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-5223ceda-235d-4620-b544-60fec603b4a7 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:22.158277 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-5223ceda-235d-4620-b544-60fec603b4a7 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:22.160192 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-5223ceda-235d-4620-b544-60fec603b4a7 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb" status: 200 len: 1721 microversion: 2.20 time: 0.190340 Sep 09 16:38:22.162059 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 400/798] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Sep 9 16:38:21 2022] GET /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb => generated 1721 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 16:38:23.188381 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-2e59e305-c83a-4873-a600-038d76465d39 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:38:23.188983 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-2e59e305-c83a-4873-a600-038d76465d39 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: e20f4f93-c27e-4971-a495-a3498f2611eb] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:38:23.197241 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2e59e305-c83a-4873-a600-038d76465d39 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:23.197709 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2e59e305-c83a-4873-a600-038d76465d39 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:23.198154 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2e59e305-c83a-4873-a600-038d76465d39 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:23.198887 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2e59e305-c83a-4873-a600-038d76465d39 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:23.199870 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2e59e305-c83a-4873-a600-038d76465d39 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:23.200298 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2e59e305-c83a-4873-a600-038d76465d39 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:23.345057 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-d024f7d2-551f-43a4-9e8b-a6b378ef92fe tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:38:23.349159 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-d024f7d2-551f-43a4-9e8b-a6b378ef92fe tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] [instance: 9bed6256-fc6f-40dd-b465-54981581a6aa] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:38:23.362336 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-2e59e305-c83a-4873-a600-038d76465d39 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:23.370690 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-d024f7d2-551f-43a4-9e8b-a6b378ef92fe tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:23.371185 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-d024f7d2-551f-43a4-9e8b-a6b378ef92fe tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:23.371618 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-d024f7d2-551f-43a4-9e8b-a6b378ef92fe tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:23.372327 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-d024f7d2-551f-43a4-9e8b-a6b378ef92fe tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:23.372779 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-d024f7d2-551f-43a4-9e8b-a6b378ef92fe tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:23.373198 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-d024f7d2-551f-43a4-9e8b-a6b378ef92fe tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:23.377524 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-2e59e305-c83a-4873-a600-038d76465d39 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:23.379171 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-2e59e305-c83a-4873-a600-038d76465d39 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:23.380368 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-2e59e305-c83a-4873-a600-038d76465d39 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb" status: 200 len: 1721 microversion: 2.20 time: 0.196661 Sep 09 16:38:23.380908 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 399/799] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Sep 9 16:38:23 2022] GET /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb => generated 1721 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 16:38:23.431862 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.objects.instance [None req-d024f7d2-551f-43a4-9e8b-a6b378ef92fe tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lazy-loading 'flavor' on Instance uuid 9bed6256-fc6f-40dd-b465-54981581a6aa {{(pid=127196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 16:38:23.446787 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-daa78e99-52b1-4bcf-a203-6abc1c739695 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:38:23.447478 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-daa78e99-52b1-4bcf-a203-6abc1c739695 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] [instance: f511030a-fedd-48ec-9d7e-c1b04ea08bc4] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:38:23.458130 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-daa78e99-52b1-4bcf-a203-6abc1c739695 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:23.458915 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-daa78e99-52b1-4bcf-a203-6abc1c739695 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:23.460076 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-daa78e99-52b1-4bcf-a203-6abc1c739695 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:23.461919 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-daa78e99-52b1-4bcf-a203-6abc1c739695 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:23.464755 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-daa78e99-52b1-4bcf-a203-6abc1c739695 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:23.465253 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-daa78e99-52b1-4bcf-a203-6abc1c739695 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:23.492510 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.wsgi [None req-daa78e99-52b1-4bcf-a203-6abc1c739695 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] HTTP exception thrown: Instance f511030a-fedd-48ec-9d7e-c1b04ea08bc4 could not be found. Sep 09 16:38:23.494383 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-daa78e99-52b1-4bcf-a203-6abc1c739695 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Request method failure captured: Sep 09 16:38:23.494383 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: request: DELETE /compute/v2.1/servers/f511030a-fedd-48ec-9d7e-c1b04ea08bc4 HTTP/1.1 Sep 09 16:38:23.494383 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Accept: application/json Sep 09 16:38:23.494383 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Accept-Encoding: identity Sep 09 16:38:23.494383 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Connection: close Sep 09 16:38:23.494383 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Content-Length: 0 Sep 09 16:38:23.494383 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Content-Type: application/json Sep 09 16:38:23.494383 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Host: 10.222.0.23 Sep 09 16:38:23.494383 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Openstack-System-Scope: None Sep 09 16:38:23.494383 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: User-Agent: python-urllib3/1.26.12 Sep 09 16:38:23.494383 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Auth-Token: gAAAAABjG2p8X7ru_JB5hJR44VQ2gJJ5-pnimmT3rRqiF7PaDSUV6TptFJkJ5B7Brlh3RUo94RsnCU-lX7lENCapIWQjRtP9b5hcyxC2h1lMkUs_mIUD6GO84yl6hoSKhKDmYwez2Ale62nt_G9YgAJhsj7sSTM8MyBYvPk9Cs4OYzLEWXRgGoo Sep 09 16:38:23.494383 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Domain-Id: None Sep 09 16:38:23.494383 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Domain-Name: None Sep 09 16:38:23.494383 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Identity-Status: Confirmed Sep 09 16:38:23.494383 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Is-Admin-Project: True Sep 09 16:38:23.494383 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Project-Domain-Id: default Sep 09 16:38:23.494383 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Project-Domain-Name: Default Sep 09 16:38:23.494383 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Project-Id: e17967a941be4a04bbc180e2cf3a7a55 Sep 09 16:38:23.494383 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Project-Name: tempest-AttachVolumeNegativeTest-456905727 Sep 09 16:38:23.494383 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Role: member,reader Sep 09 16:38:23.494383 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Roles: member,reader Sep 09 16:38:23.495955 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e17967a941be4a04bbc180e2cf3a7a55"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e17967a941be4a04bbc180e2cf3a7a55"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e17967a941be4a04bbc180e2cf3a7a55"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e17967a941be4a04bbc180e2cf3a7a55"}]}] Sep 09 16:38:23.495955 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Tenant: tempest-AttachVolumeNegativeTest-456905727 Sep 09 16:38:23.495955 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Tenant-Id: e17967a941be4a04bbc180e2cf3a7a55 Sep 09 16:38:23.495955 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-456905727 Sep 09 16:38:23.495955 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User: tempest-AttachVolumeNegativeTest-456905727-project Sep 09 16:38:23.495955 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User-Domain-Id: default Sep 09 16:38:23.495955 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User-Domain-Name: Default Sep 09 16:38:23.495955 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User-Id: 53c0721dc18343b18993ff5af098841d Sep 09 16:38:23.495955 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User-Name: tempest-AttachVolumeNegativeTest-456905727-project Sep 09 16:38:23.495955 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: method: > Sep 09 16:38:23.495955 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: exception: Instance f511030a-fedd-48ec-9d7e-c1b04ea08bc4 could not be found. Sep 09 16:38:23.495955 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: action_args: {'id': 'f511030a-fedd-48ec-9d7e-c1b04ea08bc4'} Sep 09 16:38:23.496692 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 16:38:23.496692 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:38:23.496692 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 16:38:23.496692 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 16:38:23.496692 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 16:38:23.496692 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 16:38:23.496692 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 16:38:23.496692 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 16:38:23.496692 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 16:38:23.496692 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 16:38:23.496692 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f511030a-fedd-48ec-9d7e-c1b04ea08bc4 could not be found. Sep 09 16:38:23.496692 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:38:23.496692 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 16:38:23.496692 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:38:23.496692 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:38:23.496692 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 16:38:23.496692 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 16:38:23.496692 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 16:38:23.496692 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 16:38:23.496692 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 16:38:23.497989 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 16:38:23.497989 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 09 16:38:23.497989 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 09 16:38:23.497989 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 09 16:38:23.497989 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 09 16:38:23.497989 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 16:38:23.497989 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 16:38:23.497989 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 16:38:23.497989 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 16:38:23.497989 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f511030a-fedd-48ec-9d7e-c1b04ea08bc4 could not be found. Sep 09 16:38:23.497989 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:38:23.497989 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 16:38:23.497989 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:38:23.497989 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:38:23.497989 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 16:38:23.497989 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 16:38:23.497989 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 16:38:23.497989 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 16:38:23.497989 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f511030a-fedd-48ec-9d7e-c1b04ea08bc4 could not be found. Sep 09 16:38:23.497989 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:38:23.500596 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-daa78e99-52b1-4bcf-a203-6abc1c739695 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Returning 404 to user: Instance f511030a-fedd-48ec-9d7e-c1b04ea08bc4 could not be found. {{(pid=127198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 16:38:23.500596 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-daa78e99-52b1-4bcf-a203-6abc1c739695 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] 10.222.0.23 "DELETE /compute/v2.1/servers/f511030a-fedd-48ec-9d7e-c1b04ea08bc4" status: 404 len: 111 microversion: 2.1 time: 0.054031 Sep 09 16:38:23.500596 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 400/800] 10.222.0.23 () {58 vars in 1239 bytes} [Fri Sep 9 16:38:23 2022] DELETE /compute/v2.1/servers/f511030a-fedd-48ec-9d7e-c1b04ea08bc4 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 09 16:38:23.504837 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-dda6da4c-8cc6-488c-96a8-ada97b94fb11 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:38:23.505451 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-dda6da4c-8cc6-488c-96a8-ada97b94fb11 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] [instance: f511030a-fedd-48ec-9d7e-c1b04ea08bc4] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:38:23.511643 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-dda6da4c-8cc6-488c-96a8-ada97b94fb11 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:23.512127 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-dda6da4c-8cc6-488c-96a8-ada97b94fb11 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:23.512565 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-dda6da4c-8cc6-488c-96a8-ada97b94fb11 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:23.513261 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-dda6da4c-8cc6-488c-96a8-ada97b94fb11 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:23.513718 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-dda6da4c-8cc6-488c-96a8-ada97b94fb11 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:23.514142 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-dda6da4c-8cc6-488c-96a8-ada97b94fb11 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:23.536030 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.wsgi [None req-dda6da4c-8cc6-488c-96a8-ada97b94fb11 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] HTTP exception thrown: Instance f511030a-fedd-48ec-9d7e-c1b04ea08bc4 could not be found. Sep 09 16:38:23.538005 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-dda6da4c-8cc6-488c-96a8-ada97b94fb11 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Request method failure captured: Sep 09 16:38:23.538005 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: request: GET /compute/v2.1/servers/f511030a-fedd-48ec-9d7e-c1b04ea08bc4 HTTP/1.1 Sep 09 16:38:23.538005 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Accept: application/json Sep 09 16:38:23.538005 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Accept-Encoding: identity Sep 09 16:38:23.538005 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Connection: close Sep 09 16:38:23.538005 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Content-Length: 0 Sep 09 16:38:23.538005 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Content-Type: application/json Sep 09 16:38:23.538005 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Host: 10.222.0.23 Sep 09 16:38:23.538005 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Openstack-System-Scope: None Sep 09 16:38:23.538005 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: User-Agent: python-urllib3/1.26.12 Sep 09 16:38:23.538005 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Auth-Token: gAAAAABjG2p8X7ru_JB5hJR44VQ2gJJ5-pnimmT3rRqiF7PaDSUV6TptFJkJ5B7Brlh3RUo94RsnCU-lX7lENCapIWQjRtP9b5hcyxC2h1lMkUs_mIUD6GO84yl6hoSKhKDmYwez2Ale62nt_G9YgAJhsj7sSTM8MyBYvPk9Cs4OYzLEWXRgGoo Sep 09 16:38:23.538005 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Domain-Id: None Sep 09 16:38:23.538005 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Domain-Name: None Sep 09 16:38:23.538005 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Identity-Status: Confirmed Sep 09 16:38:23.538005 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Is-Admin-Project: True Sep 09 16:38:23.538005 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Project-Domain-Id: default Sep 09 16:38:23.538005 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Project-Domain-Name: Default Sep 09 16:38:23.538005 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Project-Id: e17967a941be4a04bbc180e2cf3a7a55 Sep 09 16:38:23.538005 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Project-Name: tempest-AttachVolumeNegativeTest-456905727 Sep 09 16:38:23.538005 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Role: member,reader Sep 09 16:38:23.538005 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Roles: member,reader Sep 09 16:38:23.539751 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e17967a941be4a04bbc180e2cf3a7a55"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e17967a941be4a04bbc180e2cf3a7a55"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e17967a941be4a04bbc180e2cf3a7a55"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e17967a941be4a04bbc180e2cf3a7a55"}]}] Sep 09 16:38:23.539751 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Tenant: tempest-AttachVolumeNegativeTest-456905727 Sep 09 16:38:23.539751 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Tenant-Id: e17967a941be4a04bbc180e2cf3a7a55 Sep 09 16:38:23.539751 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-456905727 Sep 09 16:38:23.539751 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User: tempest-AttachVolumeNegativeTest-456905727-project Sep 09 16:38:23.539751 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User-Domain-Id: default Sep 09 16:38:23.539751 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User-Domain-Name: Default Sep 09 16:38:23.539751 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User-Id: 53c0721dc18343b18993ff5af098841d Sep 09 16:38:23.539751 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User-Name: tempest-AttachVolumeNegativeTest-456905727-project Sep 09 16:38:23.539751 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: method: > Sep 09 16:38:23.539751 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: exception: Instance f511030a-fedd-48ec-9d7e-c1b04ea08bc4 could not be found. Sep 09 16:38:23.539751 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: action_args: {'id': 'f511030a-fedd-48ec-9d7e-c1b04ea08bc4'} Sep 09 16:38:23.540644 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 16:38:23.540644 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:38:23.540644 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 16:38:23.540644 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 16:38:23.540644 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 16:38:23.540644 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 16:38:23.540644 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 16:38:23.540644 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 16:38:23.540644 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 16:38:23.540644 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 16:38:23.540644 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f511030a-fedd-48ec-9d7e-c1b04ea08bc4 could not be found. Sep 09 16:38:23.540644 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:38:23.540644 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 16:38:23.540644 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:38:23.540644 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:38:23.540644 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 16:38:23.540644 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 16:38:23.540644 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 16:38:23.540644 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 16:38:23.540644 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 16:38:23.543128 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 16:38:23.543128 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 16:38:23.543128 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 16:38:23.543128 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 16:38:23.543128 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 16:38:23.543128 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 16:38:23.543128 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 16:38:23.543128 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f511030a-fedd-48ec-9d7e-c1b04ea08bc4 could not be found. Sep 09 16:38:23.543128 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:38:23.543128 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 16:38:23.543128 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:38:23.543128 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:38:23.543128 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 16:38:23.543128 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 16:38:23.543128 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 16:38:23.543128 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 16:38:23.543128 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f511030a-fedd-48ec-9d7e-c1b04ea08bc4 could not be found. Sep 09 16:38:23.543128 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:38:23.545691 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-dda6da4c-8cc6-488c-96a8-ada97b94fb11 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Returning 404 to user: Instance f511030a-fedd-48ec-9d7e-c1b04ea08bc4 could not be found. {{(pid=127198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 16:38:23.545691 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-dda6da4c-8cc6-488c-96a8-ada97b94fb11 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] 10.222.0.23 "GET /compute/v2.1/servers/f511030a-fedd-48ec-9d7e-c1b04ea08bc4" status: 404 len: 111 microversion: 2.1 time: 0.038832 Sep 09 16:38:23.545691 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 401/801] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:38:23 2022] GET /compute/v2.1/servers/f511030a-fedd-48ec-9d7e-c1b04ea08bc4 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 16:38:23.562997 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-d024f7d2-551f-43a4-9e8b-a6b378ef92fe tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] 10.222.0.23 "POST /compute/v2.1/servers/9bed6256-fc6f-40dd-b465-54981581a6aa/action" status: 202 len: 0 microversion: 2.1 time: 0.222471 Sep 09 16:38:23.564067 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 401/802] 10.222.0.23 () {60 vars in 1278 bytes} [Fri Sep 9 16:38:23 2022] POST /compute/v2.1/servers/9bed6256-fc6f-40dd-b465-54981581a6aa/action => generated 0 bytes in 224 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 16:38:23.572303 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-8f8fafbd-a242-4233-888c-344ea4b1e3c9 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:38:23.573223 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-8f8fafbd-a242-4233-888c-344ea4b1e3c9 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] [instance: 9bed6256-fc6f-40dd-b465-54981581a6aa] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:38:23.580137 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8f8fafbd-a242-4233-888c-344ea4b1e3c9 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:23.580745 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8f8fafbd-a242-4233-888c-344ea4b1e3c9 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:23.581395 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8f8fafbd-a242-4233-888c-344ea4b1e3c9 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:23.582098 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8f8fafbd-a242-4233-888c-344ea4b1e3c9 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:23.582675 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8f8fafbd-a242-4233-888c-344ea4b1e3c9 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:23.583092 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8f8fafbd-a242-4233-888c-344ea4b1e3c9 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:23.730716 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-8f8fafbd-a242-4233-888c-344ea4b1e3c9 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208daa6413d34e4496e278fb3fc251a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba803ac5e71467f853215e19a7f8867', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:23.738923 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-8f8fafbd-a242-4233-888c-344ea4b1e3c9 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] 10.222.0.23 "GET /compute/v2.1/servers/9bed6256-fc6f-40dd-b465-54981581a6aa" status: 200 len: 1568 microversion: 2.1 time: 0.170488 Sep 09 16:38:23.742590 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 402/803] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:38:23 2022] GET /compute/v2.1/servers/9bed6256-fc6f-40dd-b465-54981581a6aa => generated 1568 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:38:24.407806 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-a6f7fe69-1372-4969-8c6e-a66ccd320f00 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:38:24.408497 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-a6f7fe69-1372-4969-8c6e-a66ccd320f00 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: e20f4f93-c27e-4971-a495-a3498f2611eb] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:38:24.415524 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-a6f7fe69-1372-4969-8c6e-a66ccd320f00 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:24.416090 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-a6f7fe69-1372-4969-8c6e-a66ccd320f00 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:24.416519 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-a6f7fe69-1372-4969-8c6e-a66ccd320f00 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:24.417181 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-a6f7fe69-1372-4969-8c6e-a66ccd320f00 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:24.417654 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-a6f7fe69-1372-4969-8c6e-a66ccd320f00 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:24.418054 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-a6f7fe69-1372-4969-8c6e-a66ccd320f00 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:24.563621 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-a6f7fe69-1372-4969-8c6e-a66ccd320f00 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:24.571955 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-a6f7fe69-1372-4969-8c6e-a66ccd320f00 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:24.573400 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-a6f7fe69-1372-4969-8c6e-a66ccd320f00 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:24.574584 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-a6f7fe69-1372-4969-8c6e-a66ccd320f00 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb" status: 200 len: 1721 microversion: 2.20 time: 0.171590 Sep 09 16:38:24.575158 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 402/804] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Sep 9 16:38:24 2022] GET /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb => generated 1721 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 16:38:24.763903 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-77f46f49-7657-48b8-a862-ac03f43f8d8c tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:38:24.764450 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-77f46f49-7657-48b8-a862-ac03f43f8d8c tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] [instance: 9bed6256-fc6f-40dd-b465-54981581a6aa] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:38:24.771201 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-77f46f49-7657-48b8-a862-ac03f43f8d8c tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:24.771676 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-77f46f49-7657-48b8-a862-ac03f43f8d8c tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:24.772100 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-77f46f49-7657-48b8-a862-ac03f43f8d8c tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:24.772782 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-77f46f49-7657-48b8-a862-ac03f43f8d8c tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:24.773254 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-77f46f49-7657-48b8-a862-ac03f43f8d8c tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:24.773695 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-77f46f49-7657-48b8-a862-ac03f43f8d8c tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:24.908675 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-77f46f49-7657-48b8-a862-ac03f43f8d8c tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208daa6413d34e4496e278fb3fc251a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba803ac5e71467f853215e19a7f8867', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:24.917618 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-77f46f49-7657-48b8-a862-ac03f43f8d8c tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] 10.222.0.23 "GET /compute/v2.1/servers/9bed6256-fc6f-40dd-b465-54981581a6aa" status: 200 len: 1568 microversion: 2.1 time: 0.157559 Sep 09 16:38:24.918287 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 403/805] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:38:24 2022] GET /compute/v2.1/servers/9bed6256-fc6f-40dd-b465-54981581a6aa => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:38:24.983352 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-8c7fbbc1-7bac-4f90-9ab9-1e74ddd485d3 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:38:24.983849 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-8c7fbbc1-7bac-4f90-9ab9-1e74ddd485d3 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] [instance: 11fefdc7-238f-4580-96f8-d4ba861abeea] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:38:24.989903 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-8c7fbbc1-7bac-4f90-9ab9-1e74ddd485d3 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:24.990379 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-8c7fbbc1-7bac-4f90-9ab9-1e74ddd485d3 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:24.990832 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-8c7fbbc1-7bac-4f90-9ab9-1e74ddd485d3 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:24.991507 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-8c7fbbc1-7bac-4f90-9ab9-1e74ddd485d3 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:24.991946 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-8c7fbbc1-7bac-4f90-9ab9-1e74ddd485d3 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:24.992552 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-8c7fbbc1-7bac-4f90-9ab9-1e74ddd485d3 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:25.009253 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.wsgi [None req-8c7fbbc1-7bac-4f90-9ab9-1e74ddd485d3 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] HTTP exception thrown: Instance 11fefdc7-238f-4580-96f8-d4ba861abeea could not be found. Sep 09 16:38:25.011964 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-8c7fbbc1-7bac-4f90-9ab9-1e74ddd485d3 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Request method failure captured: Sep 09 16:38:25.011964 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: request: DELETE /compute/v2.1/servers/11fefdc7-238f-4580-96f8-d4ba861abeea HTTP/1.1 Sep 09 16:38:25.011964 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Accept: application/json Sep 09 16:38:25.011964 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Accept-Encoding: identity Sep 09 16:38:25.011964 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Connection: close Sep 09 16:38:25.011964 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Content-Length: 0 Sep 09 16:38:25.011964 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Content-Type: application/json Sep 09 16:38:25.011964 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Host: 10.222.0.23 Sep 09 16:38:25.011964 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Openstack-System-Scope: None Sep 09 16:38:25.011964 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: User-Agent: python-urllib3/1.26.12 Sep 09 16:38:25.011964 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Auth-Token: gAAAAABjG2p8X7ru_JB5hJR44VQ2gJJ5-pnimmT3rRqiF7PaDSUV6TptFJkJ5B7Brlh3RUo94RsnCU-lX7lENCapIWQjRtP9b5hcyxC2h1lMkUs_mIUD6GO84yl6hoSKhKDmYwez2Ale62nt_G9YgAJhsj7sSTM8MyBYvPk9Cs4OYzLEWXRgGoo Sep 09 16:38:25.011964 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Domain-Id: None Sep 09 16:38:25.011964 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Domain-Name: None Sep 09 16:38:25.011964 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Identity-Status: Confirmed Sep 09 16:38:25.011964 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Is-Admin-Project: True Sep 09 16:38:25.011964 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Project-Domain-Id: default Sep 09 16:38:25.011964 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Project-Domain-Name: Default Sep 09 16:38:25.011964 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Project-Id: e17967a941be4a04bbc180e2cf3a7a55 Sep 09 16:38:25.011964 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Project-Name: tempest-AttachVolumeNegativeTest-456905727 Sep 09 16:38:25.011964 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Role: member,reader Sep 09 16:38:25.011964 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Roles: member,reader Sep 09 16:38:25.013265 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e17967a941be4a04bbc180e2cf3a7a55"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e17967a941be4a04bbc180e2cf3a7a55"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e17967a941be4a04bbc180e2cf3a7a55"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e17967a941be4a04bbc180e2cf3a7a55"}]}] Sep 09 16:38:25.013265 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Tenant: tempest-AttachVolumeNegativeTest-456905727 Sep 09 16:38:25.013265 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Tenant-Id: e17967a941be4a04bbc180e2cf3a7a55 Sep 09 16:38:25.013265 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-456905727 Sep 09 16:38:25.013265 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-User: tempest-AttachVolumeNegativeTest-456905727-project Sep 09 16:38:25.013265 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-User-Domain-Id: default Sep 09 16:38:25.013265 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-User-Domain-Name: Default Sep 09 16:38:25.013265 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-User-Id: 53c0721dc18343b18993ff5af098841d Sep 09 16:38:25.013265 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-User-Name: tempest-AttachVolumeNegativeTest-456905727-project Sep 09 16:38:25.013265 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: method: > Sep 09 16:38:25.013265 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: exception: Instance 11fefdc7-238f-4580-96f8-d4ba861abeea could not be found. Sep 09 16:38:25.013265 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: action_args: {'id': '11fefdc7-238f-4580-96f8-d4ba861abeea'} Sep 09 16:38:25.014060 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 16:38:25.014060 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:38:25.014060 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 16:38:25.014060 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 16:38:25.014060 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 16:38:25.014060 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 16:38:25.014060 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 16:38:25.014060 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 16:38:25.014060 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 16:38:25.014060 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 16:38:25.014060 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11fefdc7-238f-4580-96f8-d4ba861abeea could not be found. Sep 09 16:38:25.014060 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Sep 09 16:38:25.014060 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 16:38:25.014060 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Sep 09 16:38:25.014060 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:38:25.014060 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 16:38:25.014060 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 16:38:25.014060 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 16:38:25.014060 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 16:38:25.014060 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 16:38:25.015999 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 16:38:25.015999 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 09 16:38:25.015999 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 09 16:38:25.015999 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 09 16:38:25.015999 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 09 16:38:25.015999 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 16:38:25.015999 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 16:38:25.015999 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 16:38:25.015999 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 16:38:25.015999 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11fefdc7-238f-4580-96f8-d4ba861abeea could not be found. Sep 09 16:38:25.015999 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Sep 09 16:38:25.015999 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 16:38:25.015999 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Sep 09 16:38:25.015999 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:38:25.015999 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 16:38:25.015999 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 16:38:25.015999 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 16:38:25.015999 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 16:38:25.015999 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11fefdc7-238f-4580-96f8-d4ba861abeea could not be found. Sep 09 16:38:25.015999 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Sep 09 16:38:25.017191 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-8c7fbbc1-7bac-4f90-9ab9-1e74ddd485d3 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Returning 404 to user: Instance 11fefdc7-238f-4580-96f8-d4ba861abeea could not be found. {{(pid=127196) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 16:38:25.017191 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-8c7fbbc1-7bac-4f90-9ab9-1e74ddd485d3 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] 10.222.0.23 "DELETE /compute/v2.1/servers/11fefdc7-238f-4580-96f8-d4ba861abeea" status: 404 len: 111 microversion: 2.1 time: 0.037348 Sep 09 16:38:25.017335 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 403/806] 10.222.0.23 () {58 vars in 1239 bytes} [Fri Sep 9 16:38:24 2022] DELETE /compute/v2.1/servers/11fefdc7-238f-4580-96f8-d4ba861abeea => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 16:38:25.025755 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-b30e9199-1381-4972-b5c7-8adb743e5c77 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:38:25.026356 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-b30e9199-1381-4972-b5c7-8adb743e5c77 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] [instance: 11fefdc7-238f-4580-96f8-d4ba861abeea] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:38:25.032492 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b30e9199-1381-4972-b5c7-8adb743e5c77 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:25.033170 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b30e9199-1381-4972-b5c7-8adb743e5c77 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:25.034070 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b30e9199-1381-4972-b5c7-8adb743e5c77 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:25.034863 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b30e9199-1381-4972-b5c7-8adb743e5c77 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:25.035380 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b30e9199-1381-4972-b5c7-8adb743e5c77 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:25.035855 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b30e9199-1381-4972-b5c7-8adb743e5c77 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:25.049276 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-0de39254-6049-4171-9ed9-efd396ad28b7 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-475837976", "imageRef": "0b1ba34f-2223-497a-9a18-c2ad8d398aae", "flavorRef": "452", "networks": [{"uuid": "56f30ac1-7605-4504-858d-85506b8560e0"}]}} {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:38:25.057013 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.wsgi [None req-b30e9199-1381-4972-b5c7-8adb743e5c77 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] HTTP exception thrown: Instance 11fefdc7-238f-4580-96f8-d4ba861abeea could not be found. Sep 09 16:38:25.058645 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-b30e9199-1381-4972-b5c7-8adb743e5c77 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Request method failure captured: Sep 09 16:38:25.058645 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: request: GET /compute/v2.1/servers/11fefdc7-238f-4580-96f8-d4ba861abeea HTTP/1.1 Sep 09 16:38:25.058645 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Accept: application/json Sep 09 16:38:25.058645 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Accept-Encoding: identity Sep 09 16:38:25.058645 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Connection: close Sep 09 16:38:25.058645 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Content-Length: 0 Sep 09 16:38:25.058645 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Content-Type: application/json Sep 09 16:38:25.058645 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Host: 10.222.0.23 Sep 09 16:38:25.058645 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Openstack-System-Scope: None Sep 09 16:38:25.058645 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: User-Agent: python-urllib3/1.26.12 Sep 09 16:38:25.058645 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Auth-Token: gAAAAABjG2p8X7ru_JB5hJR44VQ2gJJ5-pnimmT3rRqiF7PaDSUV6TptFJkJ5B7Brlh3RUo94RsnCU-lX7lENCapIWQjRtP9b5hcyxC2h1lMkUs_mIUD6GO84yl6hoSKhKDmYwez2Ale62nt_G9YgAJhsj7sSTM8MyBYvPk9Cs4OYzLEWXRgGoo Sep 09 16:38:25.058645 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Domain-Id: None Sep 09 16:38:25.058645 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Domain-Name: None Sep 09 16:38:25.058645 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Identity-Status: Confirmed Sep 09 16:38:25.058645 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Is-Admin-Project: True Sep 09 16:38:25.058645 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Project-Domain-Id: default Sep 09 16:38:25.058645 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Project-Domain-Name: Default Sep 09 16:38:25.058645 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Project-Id: e17967a941be4a04bbc180e2cf3a7a55 Sep 09 16:38:25.058645 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Project-Name: tempest-AttachVolumeNegativeTest-456905727 Sep 09 16:38:25.058645 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Role: member,reader Sep 09 16:38:25.058645 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Roles: member,reader Sep 09 16:38:25.060128 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e17967a941be4a04bbc180e2cf3a7a55"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e17967a941be4a04bbc180e2cf3a7a55"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e17967a941be4a04bbc180e2cf3a7a55"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e17967a941be4a04bbc180e2cf3a7a55"}]}] Sep 09 16:38:25.060128 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Tenant: tempest-AttachVolumeNegativeTest-456905727 Sep 09 16:38:25.060128 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Tenant-Id: e17967a941be4a04bbc180e2cf3a7a55 Sep 09 16:38:25.060128 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-456905727 Sep 09 16:38:25.060128 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User: tempest-AttachVolumeNegativeTest-456905727-project Sep 09 16:38:25.060128 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User-Domain-Id: default Sep 09 16:38:25.060128 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User-Domain-Name: Default Sep 09 16:38:25.060128 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User-Id: 53c0721dc18343b18993ff5af098841d Sep 09 16:38:25.060128 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User-Name: tempest-AttachVolumeNegativeTest-456905727-project Sep 09 16:38:25.060128 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: method: > Sep 09 16:38:25.060128 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: exception: Instance 11fefdc7-238f-4580-96f8-d4ba861abeea could not be found. Sep 09 16:38:25.060128 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: action_args: {'id': '11fefdc7-238f-4580-96f8-d4ba861abeea'} Sep 09 16:38:25.060881 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 16:38:25.060881 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:38:25.060881 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 16:38:25.060881 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 16:38:25.060881 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 16:38:25.060881 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 16:38:25.060881 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 16:38:25.060881 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 16:38:25.060881 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 16:38:25.060881 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 16:38:25.060881 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11fefdc7-238f-4580-96f8-d4ba861abeea could not be found. Sep 09 16:38:25.060881 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:38:25.060881 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 16:38:25.060881 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:38:25.060881 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:38:25.060881 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 16:38:25.060881 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 16:38:25.060881 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 16:38:25.060881 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 16:38:25.060881 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 16:38:25.062036 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 16:38:25.062036 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 16:38:25.062036 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 16:38:25.062036 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 16:38:25.062036 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 16:38:25.062036 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 16:38:25.062036 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 16:38:25.062036 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11fefdc7-238f-4580-96f8-d4ba861abeea could not be found. Sep 09 16:38:25.062036 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:38:25.062036 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 16:38:25.062036 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:38:25.062036 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:38:25.062036 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 16:38:25.062036 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 16:38:25.062036 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 16:38:25.062036 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 16:38:25.062036 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11fefdc7-238f-4580-96f8-d4ba861abeea could not be found. Sep 09 16:38:25.062036 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:38:25.063144 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-b30e9199-1381-4972-b5c7-8adb743e5c77 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Returning 404 to user: Instance 11fefdc7-238f-4580-96f8-d4ba861abeea could not be found. {{(pid=127198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 16:38:25.063144 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-b30e9199-1381-4972-b5c7-8adb743e5c77 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] 10.222.0.23 "GET /compute/v2.1/servers/11fefdc7-238f-4580-96f8-d4ba861abeea" status: 404 len: 111 microversion: 2.1 time: 0.039966 Sep 09 16:38:25.063144 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 404/807] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:38:25 2022] GET /compute/v2.1/servers/11fefdc7-238f-4580-96f8-d4ba861abeea => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 09 16:38:25.070461 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-13a0ec54-a497-4c81-a6d8-4dc3c4ddd706 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:38:25.071177 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-13a0ec54-a497-4c81-a6d8-4dc3c4ddd706 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] [instance: 0294b919-efa9-40c8-8b3d-d83e5ce0af54] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:38:25.079685 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-13a0ec54-a497-4c81-a6d8-4dc3c4ddd706 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:25.080271 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-13a0ec54-a497-4c81-a6d8-4dc3c4ddd706 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:25.081291 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-13a0ec54-a497-4c81-a6d8-4dc3c4ddd706 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:25.081998 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-13a0ec54-a497-4c81-a6d8-4dc3c4ddd706 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:25.082451 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-13a0ec54-a497-4c81-a6d8-4dc3c4ddd706 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:25.083013 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-13a0ec54-a497-4c81-a6d8-4dc3c4ddd706 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:25.099239 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.wsgi [None req-13a0ec54-a497-4c81-a6d8-4dc3c4ddd706 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] HTTP exception thrown: Instance 0294b919-efa9-40c8-8b3d-d83e5ce0af54 could not be found. Sep 09 16:38:25.107578 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-13a0ec54-a497-4c81-a6d8-4dc3c4ddd706 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Request method failure captured: Sep 09 16:38:25.107578 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: request: DELETE /compute/v2.1/servers/0294b919-efa9-40c8-8b3d-d83e5ce0af54 HTTP/1.1 Sep 09 16:38:25.107578 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Accept: application/json Sep 09 16:38:25.107578 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Accept-Encoding: identity Sep 09 16:38:25.107578 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Connection: close Sep 09 16:38:25.107578 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Content-Length: 0 Sep 09 16:38:25.107578 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Content-Type: application/json Sep 09 16:38:25.107578 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Host: 10.222.0.23 Sep 09 16:38:25.107578 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Openstack-System-Scope: None Sep 09 16:38:25.107578 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: User-Agent: python-urllib3/1.26.12 Sep 09 16:38:25.107578 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Auth-Token: gAAAAABjG2p8X7ru_JB5hJR44VQ2gJJ5-pnimmT3rRqiF7PaDSUV6TptFJkJ5B7Brlh3RUo94RsnCU-lX7lENCapIWQjRtP9b5hcyxC2h1lMkUs_mIUD6GO84yl6hoSKhKDmYwez2Ale62nt_G9YgAJhsj7sSTM8MyBYvPk9Cs4OYzLEWXRgGoo Sep 09 16:38:25.107578 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Domain-Id: None Sep 09 16:38:25.107578 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Domain-Name: None Sep 09 16:38:25.107578 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Identity-Status: Confirmed Sep 09 16:38:25.107578 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Is-Admin-Project: True Sep 09 16:38:25.107578 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Project-Domain-Id: default Sep 09 16:38:25.107578 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Project-Domain-Name: Default Sep 09 16:38:25.107578 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Project-Id: e17967a941be4a04bbc180e2cf3a7a55 Sep 09 16:38:25.107578 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Project-Name: tempest-AttachVolumeNegativeTest-456905727 Sep 09 16:38:25.107578 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Role: member,reader Sep 09 16:38:25.107578 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Roles: member,reader Sep 09 16:38:25.109057 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e17967a941be4a04bbc180e2cf3a7a55"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e17967a941be4a04bbc180e2cf3a7a55"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e17967a941be4a04bbc180e2cf3a7a55"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e17967a941be4a04bbc180e2cf3a7a55"}]}] Sep 09 16:38:25.109057 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Tenant: tempest-AttachVolumeNegativeTest-456905727 Sep 09 16:38:25.109057 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Tenant-Id: e17967a941be4a04bbc180e2cf3a7a55 Sep 09 16:38:25.109057 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-456905727 Sep 09 16:38:25.109057 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User: tempest-AttachVolumeNegativeTest-456905727-project Sep 09 16:38:25.109057 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User-Domain-Id: default Sep 09 16:38:25.109057 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User-Domain-Name: Default Sep 09 16:38:25.109057 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User-Id: 53c0721dc18343b18993ff5af098841d Sep 09 16:38:25.109057 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User-Name: tempest-AttachVolumeNegativeTest-456905727-project Sep 09 16:38:25.109057 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: method: > Sep 09 16:38:25.109057 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: exception: Instance 0294b919-efa9-40c8-8b3d-d83e5ce0af54 could not be found. Sep 09 16:38:25.109057 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: action_args: {'id': '0294b919-efa9-40c8-8b3d-d83e5ce0af54'} Sep 09 16:38:25.109772 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 16:38:25.109772 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:38:25.109772 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 16:38:25.109772 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 16:38:25.109772 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 16:38:25.109772 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 16:38:25.109772 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 16:38:25.109772 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 16:38:25.109772 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 16:38:25.109772 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 16:38:25.109772 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0294b919-efa9-40c8-8b3d-d83e5ce0af54 could not be found. Sep 09 16:38:25.109772 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:38:25.109772 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 16:38:25.109772 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:38:25.109772 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:38:25.109772 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 16:38:25.109772 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 16:38:25.109772 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 16:38:25.109772 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 16:38:25.109772 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 16:38:25.111053 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 16:38:25.111053 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 09 16:38:25.111053 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 09 16:38:25.111053 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 09 16:38:25.111053 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 09 16:38:25.111053 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 16:38:25.111053 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 16:38:25.111053 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 16:38:25.111053 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 16:38:25.111053 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0294b919-efa9-40c8-8b3d-d83e5ce0af54 could not be found. Sep 09 16:38:25.111053 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:38:25.111053 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 16:38:25.111053 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:38:25.111053 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:38:25.111053 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 16:38:25.111053 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 16:38:25.111053 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 16:38:25.111053 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 16:38:25.111053 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0294b919-efa9-40c8-8b3d-d83e5ce0af54 could not be found. Sep 09 16:38:25.111053 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:38:25.112231 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-13a0ec54-a497-4c81-a6d8-4dc3c4ddd706 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Returning 404 to user: Instance 0294b919-efa9-40c8-8b3d-d83e5ce0af54 could not be found. {{(pid=127198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 16:38:25.112231 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-13a0ec54-a497-4c81-a6d8-4dc3c4ddd706 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] 10.222.0.23 "DELETE /compute/v2.1/servers/0294b919-efa9-40c8-8b3d-d83e5ce0af54" status: 404 len: 111 microversion: 2.1 time: 0.035842 Sep 09 16:38:25.112231 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 405/808] 10.222.0.23 () {58 vars in 1239 bytes} [Fri Sep 9 16:38:25 2022] DELETE /compute/v2.1/servers/0294b919-efa9-40c8-8b3d-d83e5ce0af54 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 09 16:38:25.112446 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.network.neutron [None req-0de39254-6049-4171-9ed9-efd396ad28b7 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] validate_networks() for [('56f30ac1-7605-4504-858d-85506b8560e0', None, None, None, None, None)] {{(pid=127196) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 16:38:25.113349 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-39bc26f1-00ac-4889-b8a2-d75ff35ca302 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:38:25.113680 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-39bc26f1-00ac-4889-b8a2-d75ff35ca302 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] [instance: 0294b919-efa9-40c8-8b3d-d83e5ce0af54] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:38:25.119822 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-39bc26f1-00ac-4889-b8a2-d75ff35ca302 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:25.120306 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-39bc26f1-00ac-4889-b8a2-d75ff35ca302 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:25.120780 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-39bc26f1-00ac-4889-b8a2-d75ff35ca302 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:25.121608 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-39bc26f1-00ac-4889-b8a2-d75ff35ca302 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:25.122068 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-39bc26f1-00ac-4889-b8a2-d75ff35ca302 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:25.122479 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-39bc26f1-00ac-4889-b8a2-d75ff35ca302 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:25.137096 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.wsgi [None req-39bc26f1-00ac-4889-b8a2-d75ff35ca302 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] HTTP exception thrown: Instance 0294b919-efa9-40c8-8b3d-d83e5ce0af54 could not be found. Sep 09 16:38:25.138169 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-39bc26f1-00ac-4889-b8a2-d75ff35ca302 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Request method failure captured: Sep 09 16:38:25.138169 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: request: GET /compute/v2.1/servers/0294b919-efa9-40c8-8b3d-d83e5ce0af54 HTTP/1.1 Sep 09 16:38:25.138169 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Accept: application/json Sep 09 16:38:25.138169 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Accept-Encoding: identity Sep 09 16:38:25.138169 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Connection: close Sep 09 16:38:25.138169 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Content-Length: 0 Sep 09 16:38:25.138169 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Content-Type: application/json Sep 09 16:38:25.138169 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Host: 10.222.0.23 Sep 09 16:38:25.138169 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Openstack-System-Scope: None Sep 09 16:38:25.138169 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: User-Agent: python-urllib3/1.26.12 Sep 09 16:38:25.138169 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Auth-Token: gAAAAABjG2p8X7ru_JB5hJR44VQ2gJJ5-pnimmT3rRqiF7PaDSUV6TptFJkJ5B7Brlh3RUo94RsnCU-lX7lENCapIWQjRtP9b5hcyxC2h1lMkUs_mIUD6GO84yl6hoSKhKDmYwez2Ale62nt_G9YgAJhsj7sSTM8MyBYvPk9Cs4OYzLEWXRgGoo Sep 09 16:38:25.138169 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Domain-Id: None Sep 09 16:38:25.138169 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Domain-Name: None Sep 09 16:38:25.138169 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Identity-Status: Confirmed Sep 09 16:38:25.138169 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Is-Admin-Project: True Sep 09 16:38:25.138169 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Project-Domain-Id: default Sep 09 16:38:25.138169 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Project-Domain-Name: Default Sep 09 16:38:25.138169 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Project-Id: e17967a941be4a04bbc180e2cf3a7a55 Sep 09 16:38:25.138169 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Project-Name: tempest-AttachVolumeNegativeTest-456905727 Sep 09 16:38:25.138169 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Role: member,reader Sep 09 16:38:25.138169 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Roles: member,reader Sep 09 16:38:25.139503 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e17967a941be4a04bbc180e2cf3a7a55"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e17967a941be4a04bbc180e2cf3a7a55"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e17967a941be4a04bbc180e2cf3a7a55"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e17967a941be4a04bbc180e2cf3a7a55"}]}] Sep 09 16:38:25.139503 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Tenant: tempest-AttachVolumeNegativeTest-456905727 Sep 09 16:38:25.139503 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Tenant-Id: e17967a941be4a04bbc180e2cf3a7a55 Sep 09 16:38:25.139503 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-456905727 Sep 09 16:38:25.139503 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User: tempest-AttachVolumeNegativeTest-456905727-project Sep 09 16:38:25.139503 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User-Domain-Id: default Sep 09 16:38:25.139503 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User-Domain-Name: Default Sep 09 16:38:25.139503 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User-Id: 53c0721dc18343b18993ff5af098841d Sep 09 16:38:25.139503 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User-Name: tempest-AttachVolumeNegativeTest-456905727-project Sep 09 16:38:25.139503 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: method: > Sep 09 16:38:25.139503 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: exception: Instance 0294b919-efa9-40c8-8b3d-d83e5ce0af54 could not be found. Sep 09 16:38:25.139503 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: action_args: {'id': '0294b919-efa9-40c8-8b3d-d83e5ce0af54'} Sep 09 16:38:25.140243 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 16:38:25.140243 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:38:25.140243 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 16:38:25.140243 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 16:38:25.140243 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 16:38:25.140243 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 16:38:25.140243 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 16:38:25.140243 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 16:38:25.140243 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 16:38:25.140243 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 16:38:25.140243 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0294b919-efa9-40c8-8b3d-d83e5ce0af54 could not be found. Sep 09 16:38:25.140243 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:38:25.140243 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 16:38:25.140243 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:38:25.140243 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:38:25.140243 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 16:38:25.140243 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 16:38:25.140243 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 16:38:25.140243 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 16:38:25.140243 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 16:38:25.141539 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 16:38:25.141539 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 16:38:25.141539 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 16:38:25.141539 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 16:38:25.141539 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 16:38:25.141539 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 16:38:25.141539 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 16:38:25.141539 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0294b919-efa9-40c8-8b3d-d83e5ce0af54 could not be found. Sep 09 16:38:25.141539 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:38:25.141539 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 16:38:25.141539 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:38:25.141539 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:38:25.141539 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 16:38:25.141539 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 16:38:25.141539 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 16:38:25.141539 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 16:38:25.141539 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0294b919-efa9-40c8-8b3d-d83e5ce0af54 could not be found. Sep 09 16:38:25.141539 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:38:25.143719 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-39bc26f1-00ac-4889-b8a2-d75ff35ca302 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Returning 404 to user: Instance 0294b919-efa9-40c8-8b3d-d83e5ce0af54 could not be found. {{(pid=127198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 16:38:25.143719 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-39bc26f1-00ac-4889-b8a2-d75ff35ca302 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] 10.222.0.23 "GET /compute/v2.1/servers/0294b919-efa9-40c8-8b3d-d83e5ce0af54" status: 404 len: 111 microversion: 2.1 time: 0.030602 Sep 09 16:38:25.143719 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 406/809] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:38:25 2022] GET /compute/v2.1/servers/0294b919-efa9-40c8-8b3d-d83e5ce0af54 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 09 16:38:25.504526 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.virt.hardware [None req-0de39254-6049-4171-9ed9-efd396ad28b7 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Flavor limits 0:0:0 {{(pid=127196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 16:38:25.505105 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.virt.hardware [None req-0de39254-6049-4171-9ed9-efd396ad28b7 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Image limits 0:0:0 {{(pid=127196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 16:38:25.505624 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.virt.hardware [None req-0de39254-6049-4171-9ed9-efd396ad28b7 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Flavor pref 0:0:0 {{(pid=127196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 16:38:25.506033 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.virt.hardware [None req-0de39254-6049-4171-9ed9-efd396ad28b7 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Image pref 0:0:0 {{(pid=127196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 16:38:25.506433 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.virt.hardware [None req-0de39254-6049-4171-9ed9-efd396ad28b7 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 16:38:25.515546 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-0de39254-6049-4171-9ed9-efd396ad28b7 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:25.515924 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-0de39254-6049-4171-9ed9-efd396ad28b7 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:25.516353 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-0de39254-6049-4171-9ed9-efd396ad28b7 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:25.517065 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-0de39254-6049-4171-9ed9-efd396ad28b7 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:25.517509 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-0de39254-6049-4171-9ed9-efd396ad28b7 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:25.517920 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-0de39254-6049-4171-9ed9-efd396ad28b7 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:25.524643 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG dbcounter [-] [127196] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=127196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:38:25.537259 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.quota [None req-0de39254-6049-4171-9ed9-efd396ad28b7 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Getting quotas for project 1c6c1e895b5a49009d67f5d7e0ab6058. Resources: {'cores', 'instances', 'ram'} {{(pid=127196) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 16:38:25.542918 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.quota [None req-0de39254-6049-4171-9ed9-efd396ad28b7 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Getting quotas for user 5ae302ea931a42b5938884e79c2ae381 and project 1c6c1e895b5a49009d67f5d7e0ab6058. Resources: {'cores', 'instances', 'ram'} {{(pid=127196) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 16:38:25.555583 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-0de39254-6049-4171-9ed9-efd396ad28b7 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Going to run 1 instances... {{(pid=127196) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 16:38:25.558067 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-0de39254-6049-4171-9ed9-efd396ad28b7 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] [instance: ce8ce7fc-5de7-4d65-b26b-e1a60b59f8a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0b1ba34f-2223-497a-9a18-c2ad8d398aae',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127196) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 16:38:25.600505 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-1b979e7d-edff-4af2-a423-81a9bd478f76 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:38:25.601107 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-1b979e7d-edff-4af2-a423-81a9bd478f76 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: e20f4f93-c27e-4971-a495-a3498f2611eb] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:38:25.604485 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-0de39254-6049-4171-9ed9-efd396ad28b7 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.564908 Sep 09 16:38:25.605455 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 404/810] 10.222.0.23 () {60 vars in 1147 bytes} [Fri Sep 9 16:38:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 567 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 09 16:38:25.609537 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1b979e7d-edff-4af2-a423-81a9bd478f76 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:25.610029 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1b979e7d-edff-4af2-a423-81a9bd478f76 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:25.610541 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1b979e7d-edff-4af2-a423-81a9bd478f76 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:25.611489 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1b979e7d-edff-4af2-a423-81a9bd478f76 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:25.612151 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1b979e7d-edff-4af2-a423-81a9bd478f76 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:25.612754 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1b979e7d-edff-4af2-a423-81a9bd478f76 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:25.616424 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-7bbae11c-e791-409e-b342-9a943199797e tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:38:25.617038 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-7bbae11c-e791-409e-b342-9a943199797e tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] [instance: ce8ce7fc-5de7-4d65-b26b-e1a60b59f8a1] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:38:25.690818 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-7bbae11c-e791-409e-b342-9a943199797e tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae302ea931a42b5938884e79c2ae381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c6c1e895b5a49009d67f5d7e0ab6058', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:25.698244 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-7bbae11c-e791-409e-b342-9a943199797e tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] 10.222.0.23 "GET /compute/v2.1/servers/ce8ce7fc-5de7-4d65-b26b-e1a60b59f8a1" status: 200 len: 1218 microversion: 2.1 time: 0.085654 Sep 09 16:38:25.699046 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 405/811] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:38:25 2022] GET /compute/v2.1/servers/ce8ce7fc-5de7-4d65-b26b-e1a60b59f8a1 => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:38:25.789213 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-1b979e7d-edff-4af2-a423-81a9bd478f76 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:25.802886 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-1b979e7d-edff-4af2-a423-81a9bd478f76 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:25.804666 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-1b979e7d-edff-4af2-a423-81a9bd478f76 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:25.806154 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-1b979e7d-edff-4af2-a423-81a9bd478f76 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb" status: 200 len: 1742 microversion: 2.20 time: 0.209522 Sep 09 16:38:25.806867 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 407/812] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Sep 9 16:38:25 2022] GET /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb => generated 1742 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 16:38:25.941677 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-0dace7d8-a350-4bdd-aeb6-b7ddf3d54e75 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:38:25.942288 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-0dace7d8-a350-4bdd-aeb6-b7ddf3d54e75 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] [instance: 9bed6256-fc6f-40dd-b465-54981581a6aa] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:38:25.948440 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-0dace7d8-a350-4bdd-aeb6-b7ddf3d54e75 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:25.949179 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-0dace7d8-a350-4bdd-aeb6-b7ddf3d54e75 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:25.950260 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-0dace7d8-a350-4bdd-aeb6-b7ddf3d54e75 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:25.951001 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-0dace7d8-a350-4bdd-aeb6-b7ddf3d54e75 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:25.951458 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-0dace7d8-a350-4bdd-aeb6-b7ddf3d54e75 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:25.951881 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-0dace7d8-a350-4bdd-aeb6-b7ddf3d54e75 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:26.090413 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-0dace7d8-a350-4bdd-aeb6-b7ddf3d54e75 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208daa6413d34e4496e278fb3fc251a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba803ac5e71467f853215e19a7f8867', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:26.099074 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-0dace7d8-a350-4bdd-aeb6-b7ddf3d54e75 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] 10.222.0.23 "GET /compute/v2.1/servers/9bed6256-fc6f-40dd-b465-54981581a6aa" status: 200 len: 1568 microversion: 2.1 time: 0.161253 Sep 09 16:38:26.099696 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 406/813] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:38:25 2022] GET /compute/v2.1/servers/9bed6256-fc6f-40dd-b465-54981581a6aa => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:38:26.312697 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-0179576c-ccac-44d2-86db-c719ddae6f21 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:38:26.313191 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-0179576c-ccac-44d2-86db-c719ddae6f21 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] [instance: c453c474-644e-4e46-9d23-b2b87716f5d7] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:38:26.319244 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0179576c-ccac-44d2-86db-c719ddae6f21 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:26.319736 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0179576c-ccac-44d2-86db-c719ddae6f21 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:26.320156 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0179576c-ccac-44d2-86db-c719ddae6f21 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:26.320836 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0179576c-ccac-44d2-86db-c719ddae6f21 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:26.321277 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0179576c-ccac-44d2-86db-c719ddae6f21 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:26.321687 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0179576c-ccac-44d2-86db-c719ddae6f21 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:26.335319 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.wsgi [None req-0179576c-ccac-44d2-86db-c719ddae6f21 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] HTTP exception thrown: Instance c453c474-644e-4e46-9d23-b2b87716f5d7 could not be found. Sep 09 16:38:26.336890 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-0179576c-ccac-44d2-86db-c719ddae6f21 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Request method failure captured: Sep 09 16:38:26.336890 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: request: DELETE /compute/v2.1/servers/c453c474-644e-4e46-9d23-b2b87716f5d7 HTTP/1.1 Sep 09 16:38:26.336890 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Accept: application/json Sep 09 16:38:26.336890 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Accept-Encoding: identity Sep 09 16:38:26.336890 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Connection: close Sep 09 16:38:26.336890 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Content-Length: 0 Sep 09 16:38:26.336890 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Content-Type: application/json Sep 09 16:38:26.336890 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Host: 10.222.0.23 Sep 09 16:38:26.336890 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Openstack-System-Scope: None Sep 09 16:38:26.336890 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: User-Agent: python-urllib3/1.26.12 Sep 09 16:38:26.336890 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Auth-Token: gAAAAABjG2p8X7ru_JB5hJR44VQ2gJJ5-pnimmT3rRqiF7PaDSUV6TptFJkJ5B7Brlh3RUo94RsnCU-lX7lENCapIWQjRtP9b5hcyxC2h1lMkUs_mIUD6GO84yl6hoSKhKDmYwez2Ale62nt_G9YgAJhsj7sSTM8MyBYvPk9Cs4OYzLEWXRgGoo Sep 09 16:38:26.336890 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Domain-Id: None Sep 09 16:38:26.336890 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Domain-Name: None Sep 09 16:38:26.336890 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Identity-Status: Confirmed Sep 09 16:38:26.336890 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Is-Admin-Project: True Sep 09 16:38:26.336890 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Project-Domain-Id: default Sep 09 16:38:26.336890 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Project-Domain-Name: Default Sep 09 16:38:26.336890 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Project-Id: e17967a941be4a04bbc180e2cf3a7a55 Sep 09 16:38:26.336890 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Project-Name: tempest-AttachVolumeNegativeTest-456905727 Sep 09 16:38:26.336890 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Role: member,reader Sep 09 16:38:26.336890 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Roles: member,reader Sep 09 16:38:26.338425 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e17967a941be4a04bbc180e2cf3a7a55"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e17967a941be4a04bbc180e2cf3a7a55"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e17967a941be4a04bbc180e2cf3a7a55"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e17967a941be4a04bbc180e2cf3a7a55"}]}] Sep 09 16:38:26.338425 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Tenant: tempest-AttachVolumeNegativeTest-456905727 Sep 09 16:38:26.338425 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Tenant-Id: e17967a941be4a04bbc180e2cf3a7a55 Sep 09 16:38:26.338425 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-456905727 Sep 09 16:38:26.338425 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User: tempest-AttachVolumeNegativeTest-456905727-project Sep 09 16:38:26.338425 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User-Domain-Id: default Sep 09 16:38:26.338425 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User-Domain-Name: Default Sep 09 16:38:26.338425 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User-Id: 53c0721dc18343b18993ff5af098841d Sep 09 16:38:26.338425 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User-Name: tempest-AttachVolumeNegativeTest-456905727-project Sep 09 16:38:26.338425 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: method: > Sep 09 16:38:26.338425 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: exception: Instance c453c474-644e-4e46-9d23-b2b87716f5d7 could not be found. Sep 09 16:38:26.338425 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: action_args: {'id': 'c453c474-644e-4e46-9d23-b2b87716f5d7'} Sep 09 16:38:26.339488 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 16:38:26.339488 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:38:26.339488 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 16:38:26.339488 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 16:38:26.339488 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 16:38:26.339488 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 16:38:26.339488 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 16:38:26.339488 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 16:38:26.339488 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 16:38:26.339488 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 16:38:26.339488 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c453c474-644e-4e46-9d23-b2b87716f5d7 could not be found. Sep 09 16:38:26.339488 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:38:26.339488 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 16:38:26.339488 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:38:26.339488 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:38:26.339488 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 16:38:26.339488 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 16:38:26.339488 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 16:38:26.339488 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 16:38:26.339488 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 16:38:26.341092 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 16:38:26.341092 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 09 16:38:26.341092 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 09 16:38:26.341092 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 09 16:38:26.341092 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 09 16:38:26.341092 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 16:38:26.341092 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 16:38:26.341092 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 16:38:26.341092 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 16:38:26.341092 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c453c474-644e-4e46-9d23-b2b87716f5d7 could not be found. Sep 09 16:38:26.341092 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:38:26.341092 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 16:38:26.341092 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:38:26.341092 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:38:26.341092 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 16:38:26.341092 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 16:38:26.341092 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 16:38:26.341092 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 16:38:26.341092 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c453c474-644e-4e46-9d23-b2b87716f5d7 could not be found. Sep 09 16:38:26.341092 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:38:26.342545 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-0179576c-ccac-44d2-86db-c719ddae6f21 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Returning 404 to user: Instance c453c474-644e-4e46-9d23-b2b87716f5d7 could not be found. {{(pid=127198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 16:38:26.342545 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-0179576c-ccac-44d2-86db-c719ddae6f21 tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c453c474-644e-4e46-9d23-b2b87716f5d7" status: 404 len: 111 microversion: 2.1 time: 0.029498 Sep 09 16:38:26.342545 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 408/814] 10.222.0.23 () {58 vars in 1239 bytes} [Fri Sep 9 16:38:26 2022] DELETE /compute/v2.1/servers/c453c474-644e-4e46-9d23-b2b87716f5d7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 16:38:26.351173 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-34e223f8-e6bf-469a-8326-877dbbc8539f tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:38:26.351834 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-34e223f8-e6bf-469a-8326-877dbbc8539f tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] [instance: c453c474-644e-4e46-9d23-b2b87716f5d7] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:38:26.357703 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-34e223f8-e6bf-469a-8326-877dbbc8539f tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:26.358175 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-34e223f8-e6bf-469a-8326-877dbbc8539f tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:26.358730 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-34e223f8-e6bf-469a-8326-877dbbc8539f tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:26.359451 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-34e223f8-e6bf-469a-8326-877dbbc8539f tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:26.359917 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-34e223f8-e6bf-469a-8326-877dbbc8539f tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:26.360333 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-34e223f8-e6bf-469a-8326-877dbbc8539f tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:26.373999 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.wsgi [None req-34e223f8-e6bf-469a-8326-877dbbc8539f tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] HTTP exception thrown: Instance c453c474-644e-4e46-9d23-b2b87716f5d7 could not be found. Sep 09 16:38:26.375534 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-34e223f8-e6bf-469a-8326-877dbbc8539f tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Request method failure captured: Sep 09 16:38:26.375534 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: request: GET /compute/v2.1/servers/c453c474-644e-4e46-9d23-b2b87716f5d7 HTTP/1.1 Sep 09 16:38:26.375534 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Accept: application/json Sep 09 16:38:26.375534 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Accept-Encoding: identity Sep 09 16:38:26.375534 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Connection: close Sep 09 16:38:26.375534 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Content-Length: 0 Sep 09 16:38:26.375534 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Content-Type: application/json Sep 09 16:38:26.375534 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Host: 10.222.0.23 Sep 09 16:38:26.375534 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Openstack-System-Scope: None Sep 09 16:38:26.375534 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: User-Agent: python-urllib3/1.26.12 Sep 09 16:38:26.375534 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Auth-Token: gAAAAABjG2p8X7ru_JB5hJR44VQ2gJJ5-pnimmT3rRqiF7PaDSUV6TptFJkJ5B7Brlh3RUo94RsnCU-lX7lENCapIWQjRtP9b5hcyxC2h1lMkUs_mIUD6GO84yl6hoSKhKDmYwez2Ale62nt_G9YgAJhsj7sSTM8MyBYvPk9Cs4OYzLEWXRgGoo Sep 09 16:38:26.375534 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Domain-Id: None Sep 09 16:38:26.375534 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Domain-Name: None Sep 09 16:38:26.375534 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Identity-Status: Confirmed Sep 09 16:38:26.375534 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Is-Admin-Project: True Sep 09 16:38:26.375534 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Project-Domain-Id: default Sep 09 16:38:26.375534 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Project-Domain-Name: Default Sep 09 16:38:26.375534 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Project-Id: e17967a941be4a04bbc180e2cf3a7a55 Sep 09 16:38:26.375534 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Project-Name: tempest-AttachVolumeNegativeTest-456905727 Sep 09 16:38:26.375534 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Role: member,reader Sep 09 16:38:26.375534 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Roles: member,reader Sep 09 16:38:26.377088 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e17967a941be4a04bbc180e2cf3a7a55"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e17967a941be4a04bbc180e2cf3a7a55"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e17967a941be4a04bbc180e2cf3a7a55"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e17967a941be4a04bbc180e2cf3a7a55"}]}] Sep 09 16:38:26.377088 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Tenant: tempest-AttachVolumeNegativeTest-456905727 Sep 09 16:38:26.377088 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Tenant-Id: e17967a941be4a04bbc180e2cf3a7a55 Sep 09 16:38:26.377088 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-456905727 Sep 09 16:38:26.377088 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-User: tempest-AttachVolumeNegativeTest-456905727-project Sep 09 16:38:26.377088 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-User-Domain-Id: default Sep 09 16:38:26.377088 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-User-Domain-Name: Default Sep 09 16:38:26.377088 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-User-Id: 53c0721dc18343b18993ff5af098841d Sep 09 16:38:26.377088 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-User-Name: tempest-AttachVolumeNegativeTest-456905727-project Sep 09 16:38:26.377088 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: method: > Sep 09 16:38:26.377088 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: exception: Instance c453c474-644e-4e46-9d23-b2b87716f5d7 could not be found. Sep 09 16:38:26.377088 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: action_args: {'id': 'c453c474-644e-4e46-9d23-b2b87716f5d7'} Sep 09 16:38:26.377930 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 16:38:26.377930 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:38:26.377930 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 16:38:26.377930 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 16:38:26.377930 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 16:38:26.377930 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 16:38:26.377930 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 16:38:26.377930 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 16:38:26.377930 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 16:38:26.377930 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 16:38:26.377930 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c453c474-644e-4e46-9d23-b2b87716f5d7 could not be found. Sep 09 16:38:26.377930 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Sep 09 16:38:26.377930 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 16:38:26.377930 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Sep 09 16:38:26.377930 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:38:26.377930 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 16:38:26.377930 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 16:38:26.377930 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 16:38:26.377930 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 16:38:26.377930 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 16:38:26.379341 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 16:38:26.379341 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 16:38:26.379341 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 16:38:26.379341 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 16:38:26.379341 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 16:38:26.379341 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 16:38:26.379341 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 16:38:26.379341 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c453c474-644e-4e46-9d23-b2b87716f5d7 could not be found. Sep 09 16:38:26.379341 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Sep 09 16:38:26.379341 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 16:38:26.379341 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Sep 09 16:38:26.379341 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:38:26.379341 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 16:38:26.379341 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 16:38:26.379341 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 16:38:26.379341 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 16:38:26.379341 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c453c474-644e-4e46-9d23-b2b87716f5d7 could not be found. Sep 09 16:38:26.379341 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Sep 09 16:38:26.380641 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-34e223f8-e6bf-469a-8326-877dbbc8539f tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] Returning 404 to user: Instance c453c474-644e-4e46-9d23-b2b87716f5d7 could not be found. {{(pid=127196) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 16:38:26.380641 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-34e223f8-e6bf-469a-8326-877dbbc8539f tempest-AttachVolumeNegativeTest-456905727 tempest-AttachVolumeNegativeTest-456905727-project] 10.222.0.23 "GET /compute/v2.1/servers/c453c474-644e-4e46-9d23-b2b87716f5d7" status: 404 len: 111 microversion: 2.1 time: 0.029497 Sep 09 16:38:26.380641 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 407/815] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:38:26 2022] GET /compute/v2.1/servers/c453c474-644e-4e46-9d23-b2b87716f5d7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 16:38:26.722060 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-0080e173-1b95-480d-ac58-1880e5854609 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:38:26.722334 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-0080e173-1b95-480d-ac58-1880e5854609 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] [instance: ce8ce7fc-5de7-4d65-b26b-e1a60b59f8a1] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:38:26.729363 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0080e173-1b95-480d-ac58-1880e5854609 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:26.730129 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0080e173-1b95-480d-ac58-1880e5854609 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:26.730868 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0080e173-1b95-480d-ac58-1880e5854609 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:26.731801 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0080e173-1b95-480d-ac58-1880e5854609 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:26.733385 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0080e173-1b95-480d-ac58-1880e5854609 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:26.734113 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0080e173-1b95-480d-ac58-1880e5854609 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:26.810025 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-0080e173-1b95-480d-ac58-1880e5854609 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae302ea931a42b5938884e79c2ae381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c6c1e895b5a49009d67f5d7e0ab6058', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:26.831275 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-0080e173-1b95-480d-ac58-1880e5854609 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] 10.222.0.23 "GET /compute/v2.1/servers/ce8ce7fc-5de7-4d65-b26b-e1a60b59f8a1" status: 200 len: 1278 microversion: 2.1 time: 0.113653 Sep 09 16:38:26.832260 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 409/816] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:38:26 2022] GET /compute/v2.1/servers/ce8ce7fc-5de7-4d65-b26b-e1a60b59f8a1 => generated 1278 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:38:26.832783 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-a3951bad-c0e6-451c-bfcc-c05fdad2f458 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:38:26.834065 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-a3951bad-c0e6-451c-bfcc-c05fdad2f458 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: e20f4f93-c27e-4971-a495-a3498f2611eb] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:38:26.840819 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-a3951bad-c0e6-451c-bfcc-c05fdad2f458 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:26.841530 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-a3951bad-c0e6-451c-bfcc-c05fdad2f458 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:26.841963 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-a3951bad-c0e6-451c-bfcc-c05fdad2f458 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:26.842691 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-a3951bad-c0e6-451c-bfcc-c05fdad2f458 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:26.843294 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-a3951bad-c0e6-451c-bfcc-c05fdad2f458 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:26.843722 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-a3951bad-c0e6-451c-bfcc-c05fdad2f458 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:27.070634 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-a3951bad-c0e6-451c-bfcc-c05fdad2f458 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:27.090061 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-a3951bad-c0e6-451c-bfcc-c05fdad2f458 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:27.091688 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-a3951bad-c0e6-451c-bfcc-c05fdad2f458 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:27.093004 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-a3951bad-c0e6-451c-bfcc-c05fdad2f458 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb" status: 200 len: 1742 microversion: 2.20 time: 0.264543 Sep 09 16:38:27.093649 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 408/817] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Sep 9 16:38:26 2022] GET /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb => generated 1742 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 16:38:27.124327 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-dc09bb87-cd1e-4c77-ac2f-a7e7a95272d7 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:38:27.124327 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-dc09bb87-cd1e-4c77-ac2f-a7e7a95272d7 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] [instance: 9bed6256-fc6f-40dd-b465-54981581a6aa] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:38:27.129409 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-dc09bb87-cd1e-4c77-ac2f-a7e7a95272d7 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:27.129894 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-dc09bb87-cd1e-4c77-ac2f-a7e7a95272d7 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:27.130325 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-dc09bb87-cd1e-4c77-ac2f-a7e7a95272d7 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:27.131060 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-dc09bb87-cd1e-4c77-ac2f-a7e7a95272d7 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:27.131507 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-dc09bb87-cd1e-4c77-ac2f-a7e7a95272d7 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:27.132145 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-dc09bb87-cd1e-4c77-ac2f-a7e7a95272d7 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:27.342777 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-dc09bb87-cd1e-4c77-ac2f-a7e7a95272d7 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208daa6413d34e4496e278fb3fc251a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba803ac5e71467f853215e19a7f8867', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:27.351151 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-dc09bb87-cd1e-4c77-ac2f-a7e7a95272d7 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] 10.222.0.23 "GET /compute/v2.1/servers/9bed6256-fc6f-40dd-b465-54981581a6aa" status: 200 len: 1568 microversion: 2.1 time: 0.232375 Sep 09 16:38:27.354834 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 410/818] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:38:27 2022] GET /compute/v2.1/servers/9bed6256-fc6f-40dd-b465-54981581a6aa => generated 1568 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:38:27.863433 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-0ae38a03-4292-4fc9-b323-cc8e21dde9f1 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:38:27.864725 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-0ae38a03-4292-4fc9-b323-cc8e21dde9f1 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] [instance: ce8ce7fc-5de7-4d65-b26b-e1a60b59f8a1] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:38:27.879378 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-0ae38a03-4292-4fc9-b323-cc8e21dde9f1 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:27.879952 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-0ae38a03-4292-4fc9-b323-cc8e21dde9f1 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:27.880458 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-0ae38a03-4292-4fc9-b323-cc8e21dde9f1 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:27.881273 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-0ae38a03-4292-4fc9-b323-cc8e21dde9f1 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:27.881828 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-0ae38a03-4292-4fc9-b323-cc8e21dde9f1 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:27.882348 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-0ae38a03-4292-4fc9-b323-cc8e21dde9f1 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:28.122004 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-4c861ddc-bb25-470b-ad47-20c6b50f69e6 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:38:28.125042 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-4c861ddc-bb25-470b-ad47-20c6b50f69e6 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: e20f4f93-c27e-4971-a495-a3498f2611eb] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:38:28.136434 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4c861ddc-bb25-470b-ad47-20c6b50f69e6 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:28.136926 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4c861ddc-bb25-470b-ad47-20c6b50f69e6 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:28.137364 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4c861ddc-bb25-470b-ad47-20c6b50f69e6 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:28.142046 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4c861ddc-bb25-470b-ad47-20c6b50f69e6 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:28.142766 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4c861ddc-bb25-470b-ad47-20c6b50f69e6 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:28.143348 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4c861ddc-bb25-470b-ad47-20c6b50f69e6 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:28.187613 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-0ae38a03-4292-4fc9-b323-cc8e21dde9f1 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae302ea931a42b5938884e79c2ae381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c6c1e895b5a49009d67f5d7e0ab6058', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:28.197608 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-0ae38a03-4292-4fc9-b323-cc8e21dde9f1 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] 10.222.0.23 "GET /compute/v2.1/servers/ce8ce7fc-5de7-4d65-b26b-e1a60b59f8a1" status: 200 len: 1318 microversion: 2.1 time: 0.345900 Sep 09 16:38:28.202619 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 409/819] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:38:27 2022] GET /compute/v2.1/servers/ce8ce7fc-5de7-4d65-b26b-e1a60b59f8a1 => generated 1318 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:38:28.375524 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-aa626aac-9ead-4aaa-a959-66e37574ff48 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:38:28.376701 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-aa626aac-9ead-4aaa-a959-66e37574ff48 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] [instance: 9bed6256-fc6f-40dd-b465-54981581a6aa] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:38:28.396877 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-aa626aac-9ead-4aaa-a959-66e37574ff48 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:28.397660 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-aa626aac-9ead-4aaa-a959-66e37574ff48 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:28.398275 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-aa626aac-9ead-4aaa-a959-66e37574ff48 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:28.403017 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-aa626aac-9ead-4aaa-a959-66e37574ff48 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:28.404040 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-aa626aac-9ead-4aaa-a959-66e37574ff48 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:28.404626 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-aa626aac-9ead-4aaa-a959-66e37574ff48 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:28.431314 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:38:28.693717 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-4c861ddc-bb25-470b-ad47-20c6b50f69e6 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:28.703282 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-4c861ddc-bb25-470b-ad47-20c6b50f69e6 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:28.705535 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-4c861ddc-bb25-470b-ad47-20c6b50f69e6 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:28.706843 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-4c861ddc-bb25-470b-ad47-20c6b50f69e6 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb" status: 200 len: 1737 microversion: 2.20 time: 0.592191 Sep 09 16:38:28.707617 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 411/820] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Sep 9 16:38:28 2022] GET /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb => generated 1737 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 16:38:28.731485 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [req-b762a758-76fe-473e-8ce7-4d69a1ed0a4c req-6b4571bf-c334-4be2-adee-99f803a0f485 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce8ce7fc-5de7-4d65-b26b-e1a60b59f8a1", "tag": "d70b166f-7e9b-4c46-b61a-8c8c2772b6d2"}]} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:38:28.749245 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-b762a758-76fe-473e-8ce7-4d69a1ed0a4c req-6b4571bf-c334-4be2-adee-99f803a0f485 service nova] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:28.749725 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-b762a758-76fe-473e-8ce7-4d69a1ed0a4c req-6b4571bf-c334-4be2-adee-99f803a0f485 service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:28.750150 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-b762a758-76fe-473e-8ce7-4d69a1ed0a4c req-6b4571bf-c334-4be2-adee-99f803a0f485 service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:28.759660 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-aa626aac-9ead-4aaa-a959-66e37574ff48 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208daa6413d34e4496e278fb3fc251a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba803ac5e71467f853215e19a7f8867', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:28.773071 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.compute.server_external_events [req-b762a758-76fe-473e-8ce7-4d69a1ed0a4c req-6b4571bf-c334-4be2-adee-99f803a0f485 service nova] Creating event network-changed:d70b166f-7e9b-4c46-b61a-8c8c2772b6d2 for instance ce8ce7fc-5de7-4d65-b26b-e1a60b59f8a1 on hv-cinder-83124 Sep 09 16:38:28.776100 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-aa626aac-9ead-4aaa-a959-66e37574ff48 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] 10.222.0.23 "GET /compute/v2.1/servers/9bed6256-fc6f-40dd-b465-54981581a6aa" status: 200 len: 1568 microversion: 2.1 time: 0.405139 Sep 09 16:38:28.777510 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 410/821] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:38:28 2022] GET /compute/v2.1/servers/9bed6256-fc6f-40dd-b465-54981581a6aa => generated 1568 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 16:38:28.779467 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [req-b762a758-76fe-473e-8ce7-4d69a1ed0a4c req-6b4571bf-c334-4be2-adee-99f803a0f485 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058657 Sep 09 16:38:28.780375 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 412/822] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Sep 9 16:38:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:38:29.229092 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-ef3133dc-b1c6-49e5-a37b-fc5b2ae9b473 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:38:29.231198 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-ef3133dc-b1c6-49e5-a37b-fc5b2ae9b473 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] [instance: ce8ce7fc-5de7-4d65-b26b-e1a60b59f8a1] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:38:29.244050 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-ef3133dc-b1c6-49e5-a37b-fc5b2ae9b473 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:29.244664 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-ef3133dc-b1c6-49e5-a37b-fc5b2ae9b473 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:29.244968 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-ef3133dc-b1c6-49e5-a37b-fc5b2ae9b473 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:29.245755 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-ef3133dc-b1c6-49e5-a37b-fc5b2ae9b473 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:29.246216 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-ef3133dc-b1c6-49e5-a37b-fc5b2ae9b473 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:29.247010 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-ef3133dc-b1c6-49e5-a37b-fc5b2ae9b473 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:29.564277 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-ef3133dc-b1c6-49e5-a37b-fc5b2ae9b473 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae302ea931a42b5938884e79c2ae381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c6c1e895b5a49009d67f5d7e0ab6058', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:29.576777 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-ef3133dc-b1c6-49e5-a37b-fc5b2ae9b473 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] 10.222.0.23 "GET /compute/v2.1/servers/ce8ce7fc-5de7-4d65-b26b-e1a60b59f8a1" status: 200 len: 1318 microversion: 2.1 time: 0.347238 Sep 09 16:38:29.577459 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 411/823] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:38:29 2022] GET /compute/v2.1/servers/ce8ce7fc-5de7-4d65-b26b-e1a60b59f8a1 => generated 1318 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:38:29.737113 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-f432dffa-ceed-46ff-8487-c530b27317b9 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:38:29.737729 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-f432dffa-ceed-46ff-8487-c530b27317b9 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: e20f4f93-c27e-4971-a495-a3498f2611eb] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:38:29.754941 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f432dffa-ceed-46ff-8487-c530b27317b9 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:29.755680 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f432dffa-ceed-46ff-8487-c530b27317b9 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:29.756131 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f432dffa-ceed-46ff-8487-c530b27317b9 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:29.773442 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [req-d57a4f99-9d8c-45a3-8aa6-a8ea79ec1831 req-f79f81b2-0a30-4b42-a53e-c44161dd0364 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e20f4f93-c27e-4971-a495-a3498f2611eb", "name": "network-vif-plugged", "status": "completed", "tag": "8bab0b25-2131-47ef-88e3-210f0d9e7556"}]} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:38:29.785091 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f432dffa-ceed-46ff-8487-c530b27317b9 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:29.785696 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f432dffa-ceed-46ff-8487-c530b27317b9 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.029s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:29.786195 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f432dffa-ceed-46ff-8487-c530b27317b9 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:29.799683 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-d57a4f99-9d8c-45a3-8aa6-a8ea79ec1831 req-f79f81b2-0a30-4b42-a53e-c44161dd0364 service nova] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:29.800233 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-d57a4f99-9d8c-45a3-8aa6-a8ea79ec1831 req-f79f81b2-0a30-4b42-a53e-c44161dd0364 service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:29.800585 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-d57a4f99-9d8c-45a3-8aa6-a8ea79ec1831 req-f79f81b2-0a30-4b42-a53e-c44161dd0364 service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:29.835143 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.compute.server_external_events [req-d57a4f99-9d8c-45a3-8aa6-a8ea79ec1831 req-f79f81b2-0a30-4b42-a53e-c44161dd0364 service nova] Creating event network-vif-plugged:8bab0b25-2131-47ef-88e3-210f0d9e7556 for instance e20f4f93-c27e-4971-a495-a3498f2611eb on hv-cinder-83124 Sep 09 16:38:29.869023 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [req-d57a4f99-9d8c-45a3-8aa6-a8ea79ec1831 req-f79f81b2-0a30-4b42-a53e-c44161dd0364 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.390019 Sep 09 16:38:29.874858 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 413/824] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Sep 9 16:38:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 16:38:29.897608 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-61f6e918-8828-4fc0-906b-e289310bff25 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:38:29.898338 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-61f6e918-8828-4fc0-906b-e289310bff25 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] [instance: 9bed6256-fc6f-40dd-b465-54981581a6aa] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:38:29.916219 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-61f6e918-8828-4fc0-906b-e289310bff25 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:29.917201 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-61f6e918-8828-4fc0-906b-e289310bff25 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:29.918250 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-61f6e918-8828-4fc0-906b-e289310bff25 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:29.920207 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-61f6e918-8828-4fc0-906b-e289310bff25 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:29.920914 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-61f6e918-8828-4fc0-906b-e289310bff25 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:29.921546 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-61f6e918-8828-4fc0-906b-e289310bff25 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:30.216690 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-f432dffa-ceed-46ff-8487-c530b27317b9 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:30.246163 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-f432dffa-ceed-46ff-8487-c530b27317b9 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:30.247961 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-f432dffa-ceed-46ff-8487-c530b27317b9 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:30.249623 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-f432dffa-ceed-46ff-8487-c530b27317b9 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb" status: 200 len: 1737 microversion: 2.20 time: 0.516129 Sep 09 16:38:30.250897 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 412/825] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Sep 9 16:38:29 2022] GET /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb => generated 1737 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 16:38:30.282518 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-61f6e918-8828-4fc0-906b-e289310bff25 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208daa6413d34e4496e278fb3fc251a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba803ac5e71467f853215e19a7f8867', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:30.296409 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-61f6e918-8828-4fc0-906b-e289310bff25 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] 10.222.0.23 "GET /compute/v2.1/servers/9bed6256-fc6f-40dd-b465-54981581a6aa" status: 200 len: 1568 microversion: 2.1 time: 0.420049 Sep 09 16:38:30.296985 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 414/826] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:38:29 2022] GET /compute/v2.1/servers/9bed6256-fc6f-40dd-b465-54981581a6aa => generated 1568 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:38:30.602354 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-d7ae6c9c-4d4b-40d8-bce8-ec380eca63a5 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:38:30.603430 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-d7ae6c9c-4d4b-40d8-bce8-ec380eca63a5 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] [instance: ce8ce7fc-5de7-4d65-b26b-e1a60b59f8a1] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:38:30.620884 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-d7ae6c9c-4d4b-40d8-bce8-ec380eca63a5 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:30.622843 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-d7ae6c9c-4d4b-40d8-bce8-ec380eca63a5 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:30.623479 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-d7ae6c9c-4d4b-40d8-bce8-ec380eca63a5 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:30.624540 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-d7ae6c9c-4d4b-40d8-bce8-ec380eca63a5 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:30.625357 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-d7ae6c9c-4d4b-40d8-bce8-ec380eca63a5 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:30.625936 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-d7ae6c9c-4d4b-40d8-bce8-ec380eca63a5 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:30.824513 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-d7ae6c9c-4d4b-40d8-bce8-ec380eca63a5 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae302ea931a42b5938884e79c2ae381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c6c1e895b5a49009d67f5d7e0ab6058', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:30.833000 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-d7ae6c9c-4d4b-40d8-bce8-ec380eca63a5 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] 10.222.0.23 "GET /compute/v2.1/servers/ce8ce7fc-5de7-4d65-b26b-e1a60b59f8a1" status: 200 len: 1318 microversion: 2.1 time: 0.234599 Sep 09 16:38:30.847075 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 413/827] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:38:30 2022] GET /compute/v2.1/servers/ce8ce7fc-5de7-4d65-b26b-e1a60b59f8a1 => generated 1318 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:38:31.319903 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-240c78c6-39c0-40c7-9e5e-f044ca08f496 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:38:31.320473 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-240c78c6-39c0-40c7-9e5e-f044ca08f496 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] [instance: 9bed6256-fc6f-40dd-b465-54981581a6aa] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:38:31.331527 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-240c78c6-39c0-40c7-9e5e-f044ca08f496 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:31.344789 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-240c78c6-39c0-40c7-9e5e-f044ca08f496 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:31.345241 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-240c78c6-39c0-40c7-9e5e-f044ca08f496 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:31.346165 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-240c78c6-39c0-40c7-9e5e-f044ca08f496 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:31.346812 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-240c78c6-39c0-40c7-9e5e-f044ca08f496 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:31.347390 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-240c78c6-39c0-40c7-9e5e-f044ca08f496 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:31.527569 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-422e0247-386e-40c5-a292-2a30e13d50f6 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:38:31.529015 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-422e0247-386e-40c5-a292-2a30e13d50f6 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: e20f4f93-c27e-4971-a495-a3498f2611eb] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:38:31.543334 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-422e0247-386e-40c5-a292-2a30e13d50f6 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:31.550374 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-422e0247-386e-40c5-a292-2a30e13d50f6 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:31.551247 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-422e0247-386e-40c5-a292-2a30e13d50f6 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:31.555572 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-422e0247-386e-40c5-a292-2a30e13d50f6 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:31.556337 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-422e0247-386e-40c5-a292-2a30e13d50f6 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:31.557018 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-422e0247-386e-40c5-a292-2a30e13d50f6 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:31.769591 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-240c78c6-39c0-40c7-9e5e-f044ca08f496 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208daa6413d34e4496e278fb3fc251a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba803ac5e71467f853215e19a7f8867', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:31.779183 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-240c78c6-39c0-40c7-9e5e-f044ca08f496 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] 10.222.0.23 "GET /compute/v2.1/servers/9bed6256-fc6f-40dd-b465-54981581a6aa" status: 200 len: 1568 microversion: 2.1 time: 0.463041 Sep 09 16:38:31.783963 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 414/828] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:38:31 2022] GET /compute/v2.1/servers/9bed6256-fc6f-40dd-b465-54981581a6aa => generated 1568 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 16:38:31.858388 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-8502c89a-a53e-4dcb-aa5f-e2be4faad6c1 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:38:31.859449 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-8502c89a-a53e-4dcb-aa5f-e2be4faad6c1 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] [instance: ce8ce7fc-5de7-4d65-b26b-e1a60b59f8a1] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:38:31.861130 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-422e0247-386e-40c5-a292-2a30e13d50f6 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:31.870069 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-422e0247-386e-40c5-a292-2a30e13d50f6 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:31.870307 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-8502c89a-a53e-4dcb-aa5f-e2be4faad6c1 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:31.870656 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-8502c89a-a53e-4dcb-aa5f-e2be4faad6c1 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:31.871295 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-8502c89a-a53e-4dcb-aa5f-e2be4faad6c1 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:31.872823 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-8502c89a-a53e-4dcb-aa5f-e2be4faad6c1 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:31.873441 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-8502c89a-a53e-4dcb-aa5f-e2be4faad6c1 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:31.874019 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-8502c89a-a53e-4dcb-aa5f-e2be4faad6c1 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:31.879016 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-422e0247-386e-40c5-a292-2a30e13d50f6 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:31.880234 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-422e0247-386e-40c5-a292-2a30e13d50f6 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb" status: 200 len: 1737 microversion: 2.20 time: 0.603008 Sep 09 16:38:31.888620 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 415/829] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Sep 9 16:38:31 2022] GET /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb => generated 1737 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 16:38:32.184217 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-8502c89a-a53e-4dcb-aa5f-e2be4faad6c1 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae302ea931a42b5938884e79c2ae381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c6c1e895b5a49009d67f5d7e0ab6058', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:32.194101 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-8502c89a-a53e-4dcb-aa5f-e2be4faad6c1 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] 10.222.0.23 "GET /compute/v2.1/servers/ce8ce7fc-5de7-4d65-b26b-e1a60b59f8a1" status: 200 len: 1318 microversion: 2.1 time: 0.340296 Sep 09 16:38:32.195598 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 415/830] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:38:31 2022] GET /compute/v2.1/servers/ce8ce7fc-5de7-4d65-b26b-e1a60b59f8a1 => generated 1318 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:38:32.807221 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-26466085-67e3-4b4a-a1b6-5b3c04cd3977 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:38:32.808950 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-26466085-67e3-4b4a-a1b6-5b3c04cd3977 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] [instance: 9bed6256-fc6f-40dd-b465-54981581a6aa] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:38:32.816570 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-26466085-67e3-4b4a-a1b6-5b3c04cd3977 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:32.817042 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-26466085-67e3-4b4a-a1b6-5b3c04cd3977 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:32.817475 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-26466085-67e3-4b4a-a1b6-5b3c04cd3977 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:32.818580 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-26466085-67e3-4b4a-a1b6-5b3c04cd3977 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:32.819310 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-26466085-67e3-4b4a-a1b6-5b3c04cd3977 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:32.819899 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-26466085-67e3-4b4a-a1b6-5b3c04cd3977 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:32.911062 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-60ed8b0d-b49d-4958-ad29-50764ded45bd tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:38:32.911832 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-60ed8b0d-b49d-4958-ad29-50764ded45bd tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: e20f4f93-c27e-4971-a495-a3498f2611eb] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:38:32.922986 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-60ed8b0d-b49d-4958-ad29-50764ded45bd tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:32.923495 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-60ed8b0d-b49d-4958-ad29-50764ded45bd tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:32.923934 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-60ed8b0d-b49d-4958-ad29-50764ded45bd tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:32.925009 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-60ed8b0d-b49d-4958-ad29-50764ded45bd tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:32.925693 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-60ed8b0d-b49d-4958-ad29-50764ded45bd tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:32.926467 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-60ed8b0d-b49d-4958-ad29-50764ded45bd tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:33.107725 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-26466085-67e3-4b4a-a1b6-5b3c04cd3977 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208daa6413d34e4496e278fb3fc251a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba803ac5e71467f853215e19a7f8867', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:33.118821 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-26466085-67e3-4b4a-a1b6-5b3c04cd3977 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] 10.222.0.23 "GET /compute/v2.1/servers/9bed6256-fc6f-40dd-b465-54981581a6aa" status: 200 len: 1568 microversion: 2.1 time: 0.315380 Sep 09 16:38:33.131412 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 416/831] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:38:32 2022] GET /compute/v2.1/servers/9bed6256-fc6f-40dd-b465-54981581a6aa => generated 1568 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:38:33.159252 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-60ed8b0d-b49d-4958-ad29-50764ded45bd tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:33.169454 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-60ed8b0d-b49d-4958-ad29-50764ded45bd tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:33.187527 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-60ed8b0d-b49d-4958-ad29-50764ded45bd tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:33.192599 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-60ed8b0d-b49d-4958-ad29-50764ded45bd tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb" status: 200 len: 1737 microversion: 2.20 time: 0.284225 Sep 09 16:38:33.194398 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 416/832] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Sep 9 16:38:32 2022] GET /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb => generated 1737 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 16:38:33.219760 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-98d7c1e9-4752-4514-ac16-21c1282f8bf5 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:38:33.221213 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-98d7c1e9-4752-4514-ac16-21c1282f8bf5 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] [instance: ce8ce7fc-5de7-4d65-b26b-e1a60b59f8a1] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:38:33.228590 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-98d7c1e9-4752-4514-ac16-21c1282f8bf5 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:33.230190 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-98d7c1e9-4752-4514-ac16-21c1282f8bf5 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:33.231074 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-98d7c1e9-4752-4514-ac16-21c1282f8bf5 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:33.232161 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-98d7c1e9-4752-4514-ac16-21c1282f8bf5 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:33.232935 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-98d7c1e9-4752-4514-ac16-21c1282f8bf5 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:33.233562 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-98d7c1e9-4752-4514-ac16-21c1282f8bf5 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:33.442988 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-98d7c1e9-4752-4514-ac16-21c1282f8bf5 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae302ea931a42b5938884e79c2ae381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c6c1e895b5a49009d67f5d7e0ab6058', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:33.454128 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-98d7c1e9-4752-4514-ac16-21c1282f8bf5 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] 10.222.0.23 "GET /compute/v2.1/servers/ce8ce7fc-5de7-4d65-b26b-e1a60b59f8a1" status: 200 len: 1318 microversion: 2.1 time: 0.239499 Sep 09 16:38:33.455431 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 417/833] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:38:33 2022] GET /compute/v2.1/servers/ce8ce7fc-5de7-4d65-b26b-e1a60b59f8a1 => generated 1318 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:38:33.527976 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [req-c0a36da7-530f-4292-b765-d8edda9a8857 req-0996ee7e-98cd-41c1-8f69-3441181edf29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce8ce7fc-5de7-4d65-b26b-e1a60b59f8a1", "name": "network-vif-plugged", "status": "completed", "tag": "d70b166f-7e9b-4c46-b61a-8c8c2772b6d2"}]} {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:38:33.550840 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [req-c0a36da7-530f-4292-b765-d8edda9a8857 req-0996ee7e-98cd-41c1-8f69-3441181edf29 service nova] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:33.551346 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [req-c0a36da7-530f-4292-b765-d8edda9a8857 req-0996ee7e-98cd-41c1-8f69-3441181edf29 service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:33.551873 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [req-c0a36da7-530f-4292-b765-d8edda9a8857 req-0996ee7e-98cd-41c1-8f69-3441181edf29 service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:33.575425 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.compute.server_external_events [req-c0a36da7-530f-4292-b765-d8edda9a8857 req-0996ee7e-98cd-41c1-8f69-3441181edf29 service nova] Creating event network-vif-plugged:d70b166f-7e9b-4c46-b61a-8c8c2772b6d2 for instance ce8ce7fc-5de7-4d65-b26b-e1a60b59f8a1 on hv-cinder-83124 Sep 09 16:38:33.586284 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [req-c0a36da7-530f-4292-b765-d8edda9a8857 req-0996ee7e-98cd-41c1-8f69-3441181edf29 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062639 Sep 09 16:38:33.586932 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 417/834] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Sep 9 16:38:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:38:34.147274 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-7af4bdad-0497-4517-b493-f3615ea16259 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:38:34.148691 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-7af4bdad-0497-4517-b493-f3615ea16259 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] [instance: 9bed6256-fc6f-40dd-b465-54981581a6aa] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:38:34.155678 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7af4bdad-0497-4517-b493-f3615ea16259 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:34.156439 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7af4bdad-0497-4517-b493-f3615ea16259 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:34.157063 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7af4bdad-0497-4517-b493-f3615ea16259 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:34.157954 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7af4bdad-0497-4517-b493-f3615ea16259 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:34.161063 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7af4bdad-0497-4517-b493-f3615ea16259 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:34.161791 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7af4bdad-0497-4517-b493-f3615ea16259 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:34.225532 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-476e3838-4009-40e2-852f-d26edff6e37d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:38:34.226408 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-476e3838-4009-40e2-852f-d26edff6e37d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: e20f4f93-c27e-4971-a495-a3498f2611eb] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:38:34.243231 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-476e3838-4009-40e2-852f-d26edff6e37d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:34.243737 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-476e3838-4009-40e2-852f-d26edff6e37d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:34.244257 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-476e3838-4009-40e2-852f-d26edff6e37d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:34.245333 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-476e3838-4009-40e2-852f-d26edff6e37d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:34.247444 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-476e3838-4009-40e2-852f-d26edff6e37d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:34.248123 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-476e3838-4009-40e2-852f-d26edff6e37d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:34.392437 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-7af4bdad-0497-4517-b493-f3615ea16259 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208daa6413d34e4496e278fb3fc251a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba803ac5e71467f853215e19a7f8867', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:34.400294 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-7af4bdad-0497-4517-b493-f3615ea16259 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] 10.222.0.23 "GET /compute/v2.1/servers/9bed6256-fc6f-40dd-b465-54981581a6aa" status: 200 len: 1568 microversion: 2.1 time: 0.256995 Sep 09 16:38:34.400860 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 418/835] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:38:34 2022] GET /compute/v2.1/servers/9bed6256-fc6f-40dd-b465-54981581a6aa => generated 1568 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 16:38:34.481828 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-4eff4c71-11a4-40e7-9c14-3b2a7ed83488 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:38:34.482447 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-4eff4c71-11a4-40e7-9c14-3b2a7ed83488 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] [instance: ce8ce7fc-5de7-4d65-b26b-e1a60b59f8a1] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:38:34.489136 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4eff4c71-11a4-40e7-9c14-3b2a7ed83488 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:34.489869 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4eff4c71-11a4-40e7-9c14-3b2a7ed83488 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:34.490557 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4eff4c71-11a4-40e7-9c14-3b2a7ed83488 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:34.492285 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4eff4c71-11a4-40e7-9c14-3b2a7ed83488 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:34.493004 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4eff4c71-11a4-40e7-9c14-3b2a7ed83488 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:34.493583 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4eff4c71-11a4-40e7-9c14-3b2a7ed83488 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:34.516062 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-476e3838-4009-40e2-852f-d26edff6e37d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:34.525787 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-476e3838-4009-40e2-852f-d26edff6e37d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:34.528115 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-476e3838-4009-40e2-852f-d26edff6e37d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:34.530018 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-476e3838-4009-40e2-852f-d26edff6e37d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb" status: 200 len: 1737 microversion: 2.20 time: 0.312245 Sep 09 16:38:34.550289 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 418/836] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Sep 9 16:38:34 2022] GET /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb => generated 1737 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 16:38:34.717715 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-4eff4c71-11a4-40e7-9c14-3b2a7ed83488 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae302ea931a42b5938884e79c2ae381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c6c1e895b5a49009d67f5d7e0ab6058', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:34.727241 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-4eff4c71-11a4-40e7-9c14-3b2a7ed83488 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] 10.222.0.23 "GET /compute/v2.1/servers/ce8ce7fc-5de7-4d65-b26b-e1a60b59f8a1" status: 200 len: 1318 microversion: 2.1 time: 0.249252 Sep 09 16:38:34.743155 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 419/837] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:38:34 2022] GET /compute/v2.1/servers/ce8ce7fc-5de7-4d65-b26b-e1a60b59f8a1 => generated 1318 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:38:35.427674 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-dd924274-2031-4cd4-a0e9-1a2b583d4dda tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:38:35.429232 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-dd924274-2031-4cd4-a0e9-1a2b583d4dda tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] [instance: 9bed6256-fc6f-40dd-b465-54981581a6aa] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:38:35.438296 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-dd924274-2031-4cd4-a0e9-1a2b583d4dda tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:35.438996 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-dd924274-2031-4cd4-a0e9-1a2b583d4dda tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:35.439418 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-dd924274-2031-4cd4-a0e9-1a2b583d4dda tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:35.440274 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-dd924274-2031-4cd4-a0e9-1a2b583d4dda tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:35.440714 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-dd924274-2031-4cd4-a0e9-1a2b583d4dda tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:35.441315 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-dd924274-2031-4cd4-a0e9-1a2b583d4dda tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:35.526041 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG dbcounter [-] [127196] Writing DB stats nova_cell0:SELECT=2 {{(pid=127196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:38:35.560783 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-80fb8e73-0d29-4890-a150-40253667dfb7 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:38:35.561687 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-80fb8e73-0d29-4890-a150-40253667dfb7 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: e20f4f93-c27e-4971-a495-a3498f2611eb] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:38:35.579796 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-80fb8e73-0d29-4890-a150-40253667dfb7 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:35.588406 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-80fb8e73-0d29-4890-a150-40253667dfb7 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:35.588987 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-80fb8e73-0d29-4890-a150-40253667dfb7 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:35.589807 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-80fb8e73-0d29-4890-a150-40253667dfb7 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:35.590339 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-80fb8e73-0d29-4890-a150-40253667dfb7 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:35.590873 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-80fb8e73-0d29-4890-a150-40253667dfb7 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:35.611710 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-dd924274-2031-4cd4-a0e9-1a2b583d4dda tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208daa6413d34e4496e278fb3fc251a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba803ac5e71467f853215e19a7f8867', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:35.622588 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-dd924274-2031-4cd4-a0e9-1a2b583d4dda tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] 10.222.0.23 "GET /compute/v2.1/servers/9bed6256-fc6f-40dd-b465-54981581a6aa" status: 200 len: 1568 microversion: 2.1 time: 0.199974 Sep 09 16:38:35.624228 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 419/838] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:38:35 2022] GET /compute/v2.1/servers/9bed6256-fc6f-40dd-b465-54981581a6aa => generated 1568 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:38:35.751057 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-51415ec5-96c8-4ac8-bc10-8d474695962e tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:38:35.751748 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-51415ec5-96c8-4ac8-bc10-8d474695962e tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] [instance: ce8ce7fc-5de7-4d65-b26b-e1a60b59f8a1] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:38:35.753770 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG dbcounter [-] [127196] Writing DB stats nova_cell0:SELECT=8 {{(pid=127196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:38:35.765111 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-51415ec5-96c8-4ac8-bc10-8d474695962e tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:35.766094 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-51415ec5-96c8-4ac8-bc10-8d474695962e tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:35.766554 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-51415ec5-96c8-4ac8-bc10-8d474695962e tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:35.768819 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-51415ec5-96c8-4ac8-bc10-8d474695962e tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:35.769283 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-51415ec5-96c8-4ac8-bc10-8d474695962e tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:35.770733 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-51415ec5-96c8-4ac8-bc10-8d474695962e tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:35.804521 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-80fb8e73-0d29-4890-a150-40253667dfb7 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:35.813936 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-80fb8e73-0d29-4890-a150-40253667dfb7 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:35.817615 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-80fb8e73-0d29-4890-a150-40253667dfb7 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:35.823256 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-80fb8e73-0d29-4890-a150-40253667dfb7 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb" status: 200 len: 1737 microversion: 2.20 time: 0.268843 Sep 09 16:38:35.827063 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 420/839] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Sep 9 16:38:35 2022] GET /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb => generated 1737 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 16:38:36.010260 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-51415ec5-96c8-4ac8-bc10-8d474695962e tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae302ea931a42b5938884e79c2ae381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c6c1e895b5a49009d67f5d7e0ab6058', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:36.025287 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-51415ec5-96c8-4ac8-bc10-8d474695962e tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] 10.222.0.23 "GET /compute/v2.1/servers/ce8ce7fc-5de7-4d65-b26b-e1a60b59f8a1" status: 200 len: 1507 microversion: 2.1 time: 0.278003 Sep 09 16:38:36.039187 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 420/840] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:38:35 2022] GET /compute/v2.1/servers/ce8ce7fc-5de7-4d65-b26b-e1a60b59f8a1 => generated 1507 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:38:36.650730 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-dbd57b03-6469-4070-9521-440e218f8d36 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:38:36.652435 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-dbd57b03-6469-4070-9521-440e218f8d36 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] [instance: 9bed6256-fc6f-40dd-b465-54981581a6aa] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:38:36.670164 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-dbd57b03-6469-4070-9521-440e218f8d36 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:36.670734 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-dbd57b03-6469-4070-9521-440e218f8d36 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:36.671170 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-dbd57b03-6469-4070-9521-440e218f8d36 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:36.671891 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-dbd57b03-6469-4070-9521-440e218f8d36 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:36.672344 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-dbd57b03-6469-4070-9521-440e218f8d36 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:36.672760 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-dbd57b03-6469-4070-9521-440e218f8d36 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:36.855734 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-bf01e2e6-a5b1-489c-bc6b-8da858f8599e tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:38:36.856520 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-bf01e2e6-a5b1-489c-bc6b-8da858f8599e tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: e20f4f93-c27e-4971-a495-a3498f2611eb] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:38:36.866723 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-bf01e2e6-a5b1-489c-bc6b-8da858f8599e tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:36.867219 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-bf01e2e6-a5b1-489c-bc6b-8da858f8599e tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:36.867659 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-bf01e2e6-a5b1-489c-bc6b-8da858f8599e tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:36.868383 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-bf01e2e6-a5b1-489c-bc6b-8da858f8599e tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:36.868834 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-bf01e2e6-a5b1-489c-bc6b-8da858f8599e tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:36.869264 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-bf01e2e6-a5b1-489c-bc6b-8da858f8599e tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:36.883312 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-dbd57b03-6469-4070-9521-440e218f8d36 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208daa6413d34e4496e278fb3fc251a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba803ac5e71467f853215e19a7f8867', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:36.893840 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-dbd57b03-6469-4070-9521-440e218f8d36 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] 10.222.0.23 "GET /compute/v2.1/servers/9bed6256-fc6f-40dd-b465-54981581a6aa" status: 200 len: 1568 microversion: 2.1 time: 0.249166 Sep 09 16:38:36.895443 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 421/841] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:38:36 2022] GET /compute/v2.1/servers/9bed6256-fc6f-40dd-b465-54981581a6aa => generated 1568 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:38:37.125665 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-bf01e2e6-a5b1-489c-bc6b-8da858f8599e tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:37.133930 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-bf01e2e6-a5b1-489c-bc6b-8da858f8599e tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:37.135699 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-bf01e2e6-a5b1-489c-bc6b-8da858f8599e tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:37.137641 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-bf01e2e6-a5b1-489c-bc6b-8da858f8599e tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb" status: 200 len: 1737 microversion: 2.20 time: 0.289632 Sep 09 16:38:37.155977 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 421/842] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Sep 9 16:38:36 2022] GET /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb => generated 1737 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 16:38:37.924918 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-fc62a600-3708-45e0-b6ec-f5b7f08b7b38 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:38:37.926378 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-fc62a600-3708-45e0-b6ec-f5b7f08b7b38 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] [instance: 9bed6256-fc6f-40dd-b465-54981581a6aa] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:38:37.938846 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fc62a600-3708-45e0-b6ec-f5b7f08b7b38 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:37.941580 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fc62a600-3708-45e0-b6ec-f5b7f08b7b38 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:37.942245 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fc62a600-3708-45e0-b6ec-f5b7f08b7b38 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:37.947547 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fc62a600-3708-45e0-b6ec-f5b7f08b7b38 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:37.948604 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fc62a600-3708-45e0-b6ec-f5b7f08b7b38 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:37.949249 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fc62a600-3708-45e0-b6ec-f5b7f08b7b38 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:38.166221 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-d2324fb6-0c66-47b4-9532-157ade9c1fc0 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:38:38.167170 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-d2324fb6-0c66-47b4-9532-157ade9c1fc0 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: e20f4f93-c27e-4971-a495-a3498f2611eb] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:38:38.178384 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-d2324fb6-0c66-47b4-9532-157ade9c1fc0 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:38.181058 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-d2324fb6-0c66-47b4-9532-157ade9c1fc0 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:38.181663 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-d2324fb6-0c66-47b4-9532-157ade9c1fc0 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:38.190977 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-d2324fb6-0c66-47b4-9532-157ade9c1fc0 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:38.191835 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-d2324fb6-0c66-47b4-9532-157ade9c1fc0 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:38.193701 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-d2324fb6-0c66-47b4-9532-157ade9c1fc0 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:38.204490 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-fc62a600-3708-45e0-b6ec-f5b7f08b7b38 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208daa6413d34e4496e278fb3fc251a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba803ac5e71467f853215e19a7f8867', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:38.216414 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-fc62a600-3708-45e0-b6ec-f5b7f08b7b38 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] 10.222.0.23 "GET /compute/v2.1/servers/9bed6256-fc6f-40dd-b465-54981581a6aa" status: 200 len: 1568 microversion: 2.1 time: 0.295646 Sep 09 16:38:38.217258 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 422/843] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:38:37 2022] GET /compute/v2.1/servers/9bed6256-fc6f-40dd-b465-54981581a6aa => generated 1568 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:38:38.397868 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-d2324fb6-0c66-47b4-9532-157ade9c1fc0 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:38.408863 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-d2324fb6-0c66-47b4-9532-157ade9c1fc0 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:38.410647 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-d2324fb6-0c66-47b4-9532-157ade9c1fc0 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:38.413215 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-d2324fb6-0c66-47b4-9532-157ade9c1fc0 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb" status: 200 len: 1737 microversion: 2.20 time: 0.250852 Sep 09 16:38:38.414219 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 422/844] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Sep 9 16:38:38 2022] GET /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb => generated 1737 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 16:38:39.245875 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-354f86fb-ded3-4812-b7ec-c2d130a55248 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:38:39.247575 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-354f86fb-ded3-4812-b7ec-c2d130a55248 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] [instance: 9bed6256-fc6f-40dd-b465-54981581a6aa] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:38:39.259130 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-354f86fb-ded3-4812-b7ec-c2d130a55248 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:39.279484 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-354f86fb-ded3-4812-b7ec-c2d130a55248 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:39.280059 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-354f86fb-ded3-4812-b7ec-c2d130a55248 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:39.282547 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-354f86fb-ded3-4812-b7ec-c2d130a55248 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:39.283096 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-354f86fb-ded3-4812-b7ec-c2d130a55248 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:39.283599 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-354f86fb-ded3-4812-b7ec-c2d130a55248 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:39.440798 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-f0e8d55e-746f-4f01-8fd0-2d13915ccc2a tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:38:39.441396 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-f0e8d55e-746f-4f01-8fd0-2d13915ccc2a tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: e20f4f93-c27e-4971-a495-a3498f2611eb] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:38:39.455777 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f0e8d55e-746f-4f01-8fd0-2d13915ccc2a tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:39.457572 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f0e8d55e-746f-4f01-8fd0-2d13915ccc2a tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:39.458231 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f0e8d55e-746f-4f01-8fd0-2d13915ccc2a tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:39.459175 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f0e8d55e-746f-4f01-8fd0-2d13915ccc2a tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:39.459812 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f0e8d55e-746f-4f01-8fd0-2d13915ccc2a tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:39.460406 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f0e8d55e-746f-4f01-8fd0-2d13915ccc2a tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:39.672581 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-354f86fb-ded3-4812-b7ec-c2d130a55248 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208daa6413d34e4496e278fb3fc251a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba803ac5e71467f853215e19a7f8867', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:39.696892 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-354f86fb-ded3-4812-b7ec-c2d130a55248 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] 10.222.0.23 "GET /compute/v2.1/servers/9bed6256-fc6f-40dd-b465-54981581a6aa" status: 200 len: 1568 microversion: 2.1 time: 0.454803 Sep 09 16:38:39.717088 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 423/845] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:38:39 2022] GET /compute/v2.1/servers/9bed6256-fc6f-40dd-b465-54981581a6aa => generated 1568 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:38:39.793430 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-f0e8d55e-746f-4f01-8fd0-2d13915ccc2a tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:39.797306 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG dbcounter [-] [127196] Writing DB stats nova_cell1:SELECT=100 {{(pid=127196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:38:39.808681 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-f0e8d55e-746f-4f01-8fd0-2d13915ccc2a tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:39.811864 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-f0e8d55e-746f-4f01-8fd0-2d13915ccc2a tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:39.816429 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-f0e8d55e-746f-4f01-8fd0-2d13915ccc2a tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb" status: 200 len: 1737 microversion: 2.20 time: 0.379701 Sep 09 16:38:39.820415 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 423/846] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Sep 9 16:38:39 2022] GET /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb => generated 1737 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 16:38:40.736602 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-0c2ad73a-424b-4118-ae12-20100a3c82de tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:38:40.738189 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-0c2ad73a-424b-4118-ae12-20100a3c82de tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] [instance: 9bed6256-fc6f-40dd-b465-54981581a6aa] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:38:40.746117 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0c2ad73a-424b-4118-ae12-20100a3c82de tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:40.746889 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0c2ad73a-424b-4118-ae12-20100a3c82de tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:40.747526 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0c2ad73a-424b-4118-ae12-20100a3c82de tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:40.748235 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0c2ad73a-424b-4118-ae12-20100a3c82de tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:40.748687 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0c2ad73a-424b-4118-ae12-20100a3c82de tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:40.749106 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0c2ad73a-424b-4118-ae12-20100a3c82de tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:40.851558 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-3fa89d02-03b3-46b5-b4d6-b062c864e1d8 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:38:40.852264 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-3fa89d02-03b3-46b5-b4d6-b062c864e1d8 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: e20f4f93-c27e-4971-a495-a3498f2611eb] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:38:40.874036 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-3fa89d02-03b3-46b5-b4d6-b062c864e1d8 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:40.874923 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-3fa89d02-03b3-46b5-b4d6-b062c864e1d8 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:40.875593 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-3fa89d02-03b3-46b5-b4d6-b062c864e1d8 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:40.878478 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-3fa89d02-03b3-46b5-b4d6-b062c864e1d8 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:40.879258 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-3fa89d02-03b3-46b5-b4d6-b062c864e1d8 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:40.880188 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-3fa89d02-03b3-46b5-b4d6-b062c864e1d8 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:40.927138 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-0c2ad73a-424b-4118-ae12-20100a3c82de tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208daa6413d34e4496e278fb3fc251a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba803ac5e71467f853215e19a7f8867', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:40.938845 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-0c2ad73a-424b-4118-ae12-20100a3c82de tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] 10.222.0.23 "GET /compute/v2.1/servers/9bed6256-fc6f-40dd-b465-54981581a6aa" status: 200 len: 1568 microversion: 2.1 time: 0.207807 Sep 09 16:38:40.939778 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 424/847] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:38:40 2022] GET /compute/v2.1/servers/9bed6256-fc6f-40dd-b465-54981581a6aa => generated 1568 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:38:41.077874 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-3fa89d02-03b3-46b5-b4d6-b062c864e1d8 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:41.100521 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-3fa89d02-03b3-46b5-b4d6-b062c864e1d8 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:41.103987 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-3fa89d02-03b3-46b5-b4d6-b062c864e1d8 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:41.105912 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-3fa89d02-03b3-46b5-b4d6-b062c864e1d8 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb" status: 200 len: 1737 microversion: 2.20 time: 0.259929 Sep 09 16:38:41.106738 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 424/848] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Sep 9 16:38:40 2022] GET /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb => generated 1737 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 16:38:41.965134 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-e80ae580-1c4e-495a-a32c-c7a6b62534bf tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:38:41.966111 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-e80ae580-1c4e-495a-a32c-c7a6b62534bf tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] [instance: 9bed6256-fc6f-40dd-b465-54981581a6aa] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:38:41.972187 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e80ae580-1c4e-495a-a32c-c7a6b62534bf tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:41.972882 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e80ae580-1c4e-495a-a32c-c7a6b62534bf tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:41.973528 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e80ae580-1c4e-495a-a32c-c7a6b62534bf tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:41.974212 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e80ae580-1c4e-495a-a32c-c7a6b62534bf tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:41.974855 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e80ae580-1c4e-495a-a32c-c7a6b62534bf tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:41.975453 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e80ae580-1c4e-495a-a32c-c7a6b62534bf tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:42.135576 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-fe7e86f5-34fc-4c1f-9f46-2cf6196fc896 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:38:42.137427 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-fe7e86f5-34fc-4c1f-9f46-2cf6196fc896 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: e20f4f93-c27e-4971-a495-a3498f2611eb] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:38:42.149859 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-fe7e86f5-34fc-4c1f-9f46-2cf6196fc896 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:42.150635 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-fe7e86f5-34fc-4c1f-9f46-2cf6196fc896 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:42.151316 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-fe7e86f5-34fc-4c1f-9f46-2cf6196fc896 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:42.152252 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-fe7e86f5-34fc-4c1f-9f46-2cf6196fc896 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:42.152895 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-fe7e86f5-34fc-4c1f-9f46-2cf6196fc896 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:42.153626 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-fe7e86f5-34fc-4c1f-9f46-2cf6196fc896 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:42.184591 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-e80ae580-1c4e-495a-a32c-c7a6b62534bf tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208daa6413d34e4496e278fb3fc251a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba803ac5e71467f853215e19a7f8867', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:42.192882 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-e80ae580-1c4e-495a-a32c-c7a6b62534bf tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] 10.222.0.23 "GET /compute/v2.1/servers/9bed6256-fc6f-40dd-b465-54981581a6aa" status: 200 len: 1568 microversion: 2.1 time: 0.232149 Sep 09 16:38:42.193990 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 425/849] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:38:41 2022] GET /compute/v2.1/servers/9bed6256-fc6f-40dd-b465-54981581a6aa => generated 1568 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:38:42.405318 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-fe7e86f5-34fc-4c1f-9f46-2cf6196fc896 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:42.415212 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-fe7e86f5-34fc-4c1f-9f46-2cf6196fc896 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:42.417583 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-fe7e86f5-34fc-4c1f-9f46-2cf6196fc896 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:42.419003 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-fe7e86f5-34fc-4c1f-9f46-2cf6196fc896 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb" status: 200 len: 1719 microversion: 2.20 time: 0.290412 Sep 09 16:38:42.419989 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 425/850] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Sep 9 16:38:42 2022] GET /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb => generated 1719 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 16:38:43.217684 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-5be19c31-d631-447f-8ae4-7b9ff1f87333 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:38:43.218364 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-5be19c31-d631-447f-8ae4-7b9ff1f87333 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] [instance: 9bed6256-fc6f-40dd-b465-54981581a6aa] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:38:43.226466 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5be19c31-d631-447f-8ae4-7b9ff1f87333 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:43.226982 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5be19c31-d631-447f-8ae4-7b9ff1f87333 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:43.227412 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5be19c31-d631-447f-8ae4-7b9ff1f87333 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:43.228327 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5be19c31-d631-447f-8ae4-7b9ff1f87333 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:43.228850 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5be19c31-d631-447f-8ae4-7b9ff1f87333 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:43.229407 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5be19c31-d631-447f-8ae4-7b9ff1f87333 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:43.373656 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-5be19c31-d631-447f-8ae4-7b9ff1f87333 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208daa6413d34e4496e278fb3fc251a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba803ac5e71467f853215e19a7f8867', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:43.381490 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-5be19c31-d631-447f-8ae4-7b9ff1f87333 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] 10.222.0.23 "GET /compute/v2.1/servers/9bed6256-fc6f-40dd-b465-54981581a6aa" status: 200 len: 1509 microversion: 2.1 time: 0.167862 Sep 09 16:38:43.382045 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 426/851] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:38:43 2022] GET /compute/v2.1/servers/9bed6256-fc6f-40dd-b465-54981581a6aa => generated 1509 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:38:43.404655 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-b5b90518-1398-4e2d-b104-5703e67f5834 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:38:43.405263 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-b5b90518-1398-4e2d-b104-5703e67f5834 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] [instance: 9bed6256-fc6f-40dd-b465-54981581a6aa] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:38:43.411835 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-b5b90518-1398-4e2d-b104-5703e67f5834 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:43.412319 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-b5b90518-1398-4e2d-b104-5703e67f5834 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:43.412760 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-b5b90518-1398-4e2d-b104-5703e67f5834 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:43.413789 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-b5b90518-1398-4e2d-b104-5703e67f5834 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:43.414239 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-b5b90518-1398-4e2d-b104-5703e67f5834 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:43.414700 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-b5b90518-1398-4e2d-b104-5703e67f5834 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:43.445291 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-599cd815-bed7-467a-97e1-e821ac675812 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:38:43.445993 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-599cd815-bed7-467a-97e1-e821ac675812 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: e20f4f93-c27e-4971-a495-a3498f2611eb] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:38:43.447066 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-b5b90518-1398-4e2d-b104-5703e67f5834 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] [instance: 9bed6256-fc6f-40dd-b465-54981581a6aa] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127196) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 09 16:38:43.452616 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-599cd815-bed7-467a-97e1-e821ac675812 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:43.453096 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-599cd815-bed7-467a-97e1-e821ac675812 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:43.453524 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-599cd815-bed7-467a-97e1-e821ac675812 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:43.454202 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-599cd815-bed7-467a-97e1-e821ac675812 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:43.454897 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-599cd815-bed7-467a-97e1-e821ac675812 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:43.455317 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-599cd815-bed7-467a-97e1-e821ac675812 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:43.520801 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-b5b90518-1398-4e2d-b104-5703e67f5834 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] 10.222.0.23 "POST /compute/v2.1/servers/9bed6256-fc6f-40dd-b465-54981581a6aa/action" status: 202 len: 0 microversion: 2.1 time: 0.120224 Sep 09 16:38:43.521429 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 426/852] 10.222.0.23 () {60 vars in 1278 bytes} [Fri Sep 9 16:38:43 2022] POST /compute/v2.1/servers/9bed6256-fc6f-40dd-b465-54981581a6aa/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 16:38:43.529681 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-d0e5de0d-9484-4510-b960-cbbfdd8d71af tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:38:43.530295 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-d0e5de0d-9484-4510-b960-cbbfdd8d71af tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] [instance: 9bed6256-fc6f-40dd-b465-54981581a6aa] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:38:43.539781 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-d0e5de0d-9484-4510-b960-cbbfdd8d71af tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:43.540123 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-d0e5de0d-9484-4510-b960-cbbfdd8d71af tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:43.540551 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-d0e5de0d-9484-4510-b960-cbbfdd8d71af tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:43.541465 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-d0e5de0d-9484-4510-b960-cbbfdd8d71af tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:43.542312 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-d0e5de0d-9484-4510-b960-cbbfdd8d71af tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:43.543052 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-d0e5de0d-9484-4510-b960-cbbfdd8d71af tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:43.676235 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-599cd815-bed7-467a-97e1-e821ac675812 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:43.689831 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-599cd815-bed7-467a-97e1-e821ac675812 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:43.691459 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-599cd815-bed7-467a-97e1-e821ac675812 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:43.692643 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-599cd815-bed7-467a-97e1-e821ac675812 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb" status: 200 len: 1719 microversion: 2.20 time: 0.251297 Sep 09 16:38:43.698228 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 427/853] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Sep 9 16:38:43 2022] GET /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb => generated 1719 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 16:38:43.775590 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-d0e5de0d-9484-4510-b960-cbbfdd8d71af tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208daa6413d34e4496e278fb3fc251a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba803ac5e71467f853215e19a7f8867', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:43.784323 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-d0e5de0d-9484-4510-b960-cbbfdd8d71af tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] 10.222.0.23 "GET /compute/v2.1/servers/9bed6256-fc6f-40dd-b465-54981581a6aa" status: 200 len: 1517 microversion: 2.1 time: 0.258533 Sep 09 16:38:43.785095 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 427/854] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:38:43 2022] GET /compute/v2.1/servers/9bed6256-fc6f-40dd-b465-54981581a6aa => generated 1517 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:38:44.724506 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-a6790738-b8b0-4d80-b080-a3a5f25fd64f tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:38:44.725102 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-a6790738-b8b0-4d80-b080-a3a5f25fd64f tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: e20f4f93-c27e-4971-a495-a3498f2611eb] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:38:44.729092 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 09 16:38:44.729346 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Fri Sep 9 16:38:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb (ip 10.222.0.23) !!! Sep 09 16:38:44.734075 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a6790738-b8b0-4d80-b080-a3a5f25fd64f tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:44.734778 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a6790738-b8b0-4d80-b080-a3a5f25fd64f tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:44.735209 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a6790738-b8b0-4d80-b080-a3a5f25fd64f tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:44.735930 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a6790738-b8b0-4d80-b080-a3a5f25fd64f tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:44.736415 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a6790738-b8b0-4d80-b080-a3a5f25fd64f tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:44.736830 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a6790738-b8b0-4d80-b080-a3a5f25fd64f tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:44.820867 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-80e2a28a-4684-4c65-858d-2cbb4051025f tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:38:44.821545 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-80e2a28a-4684-4c65-858d-2cbb4051025f tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] [instance: 9bed6256-fc6f-40dd-b465-54981581a6aa] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:38:44.828307 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-80e2a28a-4684-4c65-858d-2cbb4051025f tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:44.829091 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-80e2a28a-4684-4c65-858d-2cbb4051025f tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:44.829693 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-80e2a28a-4684-4c65-858d-2cbb4051025f tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:44.830407 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-80e2a28a-4684-4c65-858d-2cbb4051025f tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:44.831098 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-80e2a28a-4684-4c65-858d-2cbb4051025f tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:44.831687 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-80e2a28a-4684-4c65-858d-2cbb4051025f tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:44.922118 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-a6790738-b8b0-4d80-b080-a3a5f25fd64f tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:44.933663 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-a6790738-b8b0-4d80-b080-a3a5f25fd64f tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:44.935181 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-a6790738-b8b0-4d80-b080-a3a5f25fd64f tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:44.936880 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-a6790738-b8b0-4d80-b080-a3a5f25fd64f tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb" status: 200 len: 1719 microversion: 2.20 time: 0.217149 Sep 09 16:38:44.937636 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 428/855] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Sep 9 16:38:44 2022] GET /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb => generated 1719 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 16:38:45.008070 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-80e2a28a-4684-4c65-858d-2cbb4051025f tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208daa6413d34e4496e278fb3fc251a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba803ac5e71467f853215e19a7f8867', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:45.015947 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-80e2a28a-4684-4c65-858d-2cbb4051025f tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] 10.222.0.23 "GET /compute/v2.1/servers/9bed6256-fc6f-40dd-b465-54981581a6aa" status: 200 len: 1519 microversion: 2.1 time: 0.210674 Sep 09 16:38:45.016542 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 428/856] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:38:44 2022] GET /compute/v2.1/servers/9bed6256-fc6f-40dd-b465-54981581a6aa => generated 1519 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:38:45.467090 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [req-52fcfa97-79a6-4a23-bea5-77c1d61ff7d6 req-75d6471e-03e2-46a7-81fe-985095c67fda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bed6256-fc6f-40dd-b465-54981581a6aa", "name": "network-vif-unplugged", "status": "completed", "tag": "7151e062-a48c-4cc1-be6e-dbf4d66de6e4"}]} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:38:45.496665 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-52fcfa97-79a6-4a23-bea5-77c1d61ff7d6 req-75d6471e-03e2-46a7-81fe-985095c67fda service nova] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:45.497330 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-52fcfa97-79a6-4a23-bea5-77c1d61ff7d6 req-75d6471e-03e2-46a7-81fe-985095c67fda service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:45.497861 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-52fcfa97-79a6-4a23-bea5-77c1d61ff7d6 req-75d6471e-03e2-46a7-81fe-985095c67fda service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:45.510832 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.compute.server_external_events [req-52fcfa97-79a6-4a23-bea5-77c1d61ff7d6 req-75d6471e-03e2-46a7-81fe-985095c67fda service nova] Creating event network-vif-unplugged:7151e062-a48c-4cc1-be6e-dbf4d66de6e4 for instance 9bed6256-fc6f-40dd-b465-54981581a6aa on hv-cinder-83124 Sep 09 16:38:45.516423 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [req-52fcfa97-79a6-4a23-bea5-77c1d61ff7d6 req-75d6471e-03e2-46a7-81fe-985095c67fda service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.054745 Sep 09 16:38:45.517148 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 429/857] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Sep 9 16:38:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:38:45.965358 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-a6dd12c9-5d41-4f40-a12c-ec255bc4eaf4 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:38:45.965999 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-a6dd12c9-5d41-4f40-a12c-ec255bc4eaf4 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: e20f4f93-c27e-4971-a495-a3498f2611eb] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:38:45.972580 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-a6dd12c9-5d41-4f40-a12c-ec255bc4eaf4 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:45.973056 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-a6dd12c9-5d41-4f40-a12c-ec255bc4eaf4 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:45.973495 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-a6dd12c9-5d41-4f40-a12c-ec255bc4eaf4 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:45.974177 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-a6dd12c9-5d41-4f40-a12c-ec255bc4eaf4 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:45.974673 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-a6dd12c9-5d41-4f40-a12c-ec255bc4eaf4 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:45.975071 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-a6dd12c9-5d41-4f40-a12c-ec255bc4eaf4 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:46.041387 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-2a90e726-f233-4615-aebc-9c1fbe4bb042 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:38:46.044030 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-2a90e726-f233-4615-aebc-9c1fbe4bb042 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] [instance: 9bed6256-fc6f-40dd-b465-54981581a6aa] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:38:46.055777 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2a90e726-f233-4615-aebc-9c1fbe4bb042 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:46.056639 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2a90e726-f233-4615-aebc-9c1fbe4bb042 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:46.057239 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2a90e726-f233-4615-aebc-9c1fbe4bb042 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:46.059068 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2a90e726-f233-4615-aebc-9c1fbe4bb042 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:46.059736 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2a90e726-f233-4615-aebc-9c1fbe4bb042 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:46.060160 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2a90e726-f233-4615-aebc-9c1fbe4bb042 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:46.066764 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell1:SELECT=100 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:38:46.181249 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-a6dd12c9-5d41-4f40-a12c-ec255bc4eaf4 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:46.203718 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-a6dd12c9-5d41-4f40-a12c-ec255bc4eaf4 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:46.205603 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-a6dd12c9-5d41-4f40-a12c-ec255bc4eaf4 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:46.207415 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-a6dd12c9-5d41-4f40-a12c-ec255bc4eaf4 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb" status: 200 len: 1662 microversion: 2.20 time: 0.245884 Sep 09 16:38:46.208242 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 429/858] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Sep 9 16:38:45 2022] GET /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb => generated 1662 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 16:38:46.237313 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-2273caf7-22e7-4d42-9d06-6e23b44ae4f1 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fe8e93fa-7321-4aeb-b0ac-6af37c4cd1c8"}} {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:38:46.241826 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-2273caf7-22e7-4d42-9d06-6e23b44ae4f1 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: e20f4f93-c27e-4971-a495-a3498f2611eb] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:38:46.248605 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-2273caf7-22e7-4d42-9d06-6e23b44ae4f1 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:46.249087 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-2273caf7-22e7-4d42-9d06-6e23b44ae4f1 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:46.249515 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-2273caf7-22e7-4d42-9d06-6e23b44ae4f1 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:46.250209 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-2273caf7-22e7-4d42-9d06-6e23b44ae4f1 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:46.250687 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-2273caf7-22e7-4d42-9d06-6e23b44ae4f1 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:46.251136 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-2273caf7-22e7-4d42-9d06-6e23b44ae4f1 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:46.285473 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-2a90e726-f233-4615-aebc-9c1fbe4bb042 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208daa6413d34e4496e278fb3fc251a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba803ac5e71467f853215e19a7f8867', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:46.294027 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-2a90e726-f233-4615-aebc-9c1fbe4bb042 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] 10.222.0.23 "GET /compute/v2.1/servers/9bed6256-fc6f-40dd-b465-54981581a6aa" status: 200 len: 1575 microversion: 2.1 time: 0.257989 Sep 09 16:38:46.294626 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 430/859] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:38:46 2022] GET /compute/v2.1/servers/9bed6256-fc6f-40dd-b465-54981581a6aa => generated 1575 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:38:46.727261 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-2273caf7-22e7-4d42-9d06-6e23b44ae4f1 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "POST /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.494245 Sep 09 16:38:46.727840 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 430/860] 10.222.0.23 () {62 vars in 1364 bytes} [Fri Sep 9 16:38:46 2022] POST /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb/os-volume_attachments => generated 188 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 09 16:38:46.892688 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-8b0daed6-ea3d-4112-8530-b70788d0f86d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:38:46.893635 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-8b0daed6-ea3d-4112-8530-b70788d0f86d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: e20f4f93-c27e-4971-a495-a3498f2611eb] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:38:46.899481 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8b0daed6-ea3d-4112-8530-b70788d0f86d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:46.899959 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8b0daed6-ea3d-4112-8530-b70788d0f86d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:46.900388 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8b0daed6-ea3d-4112-8530-b70788d0f86d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:46.901119 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8b0daed6-ea3d-4112-8530-b70788d0f86d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:46.901561 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8b0daed6-ea3d-4112-8530-b70788d0f86d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:46.901983 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8b0daed6-ea3d-4112-8530-b70788d0f86d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:47.191695 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-8b0daed6-ea3d-4112-8530-b70788d0f86d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "DELETE /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb/os-volume_attachments/fe8e93fa-7321-4aeb-b0ac-6af37c4cd1c8" status: 202 len: 0 microversion: 2.20 time: 0.303076 Sep 09 16:38:47.192506 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 431/861] 10.222.0.23 () {60 vars in 1457 bytes} [Fri Sep 9 16:38:46 2022] DELETE /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb/os-volume_attachments/fe8e93fa-7321-4aeb-b0ac-6af37c4cd1c8 => generated 0 bytes in 305 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 09 16:38:47.259882 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-bafe0567-3e26-4523-bf5b-e5076b7c529e tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:38:47.261278 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-bafe0567-3e26-4523-bf5b-e5076b7c529e tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: e20f4f93-c27e-4971-a495-a3498f2611eb] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:38:47.271393 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-bafe0567-3e26-4523-bf5b-e5076b7c529e tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:47.272018 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-bafe0567-3e26-4523-bf5b-e5076b7c529e tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:47.272451 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-bafe0567-3e26-4523-bf5b-e5076b7c529e tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:47.273185 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-bafe0567-3e26-4523-bf5b-e5076b7c529e tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:47.273755 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-bafe0567-3e26-4523-bf5b-e5076b7c529e tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:47.274202 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-bafe0567-3e26-4523-bf5b-e5076b7c529e tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:47.313735 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-bafe0567-3e26-4523-bf5b-e5076b7c529e tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: e20f4f93-c27e-4971-a495-a3498f2611eb] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127196) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 09 16:38:47.319863 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-5ed98f9a-bbe0-463c-8607-57020ab99dbd tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:38:47.320794 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-5ed98f9a-bbe0-463c-8607-57020ab99dbd tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] [instance: 9bed6256-fc6f-40dd-b465-54981581a6aa] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:38:47.330993 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5ed98f9a-bbe0-463c-8607-57020ab99dbd tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:47.332566 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5ed98f9a-bbe0-463c-8607-57020ab99dbd tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:47.335235 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5ed98f9a-bbe0-463c-8607-57020ab99dbd tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:47.336693 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5ed98f9a-bbe0-463c-8607-57020ab99dbd tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:47.337331 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5ed98f9a-bbe0-463c-8607-57020ab99dbd tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:47.337936 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5ed98f9a-bbe0-463c-8607-57020ab99dbd tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:47.399604 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-bafe0567-3e26-4523-bf5b-e5076b7c529e tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "POST /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb/action" status: 202 len: 0 microversion: 2.20 time: 0.144397 Sep 09 16:38:47.400347 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 431/862] 10.222.0.23 () {62 vars in 1319 bytes} [Fri Sep 9 16:38:47 2022] POST /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb/action => generated 0 bytes in 147 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 09 16:38:47.409387 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-589c994c-042b-42de-b00e-8b4141c64dab tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:38:47.410666 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-589c994c-042b-42de-b00e-8b4141c64dab tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: e20f4f93-c27e-4971-a495-a3498f2611eb] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:38:47.417948 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-589c994c-042b-42de-b00e-8b4141c64dab tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:47.418795 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-589c994c-042b-42de-b00e-8b4141c64dab tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:47.419409 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-589c994c-042b-42de-b00e-8b4141c64dab tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:47.420274 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-589c994c-042b-42de-b00e-8b4141c64dab tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:47.420873 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-589c994c-042b-42de-b00e-8b4141c64dab tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:47.421655 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-589c994c-042b-42de-b00e-8b4141c64dab tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:47.638704 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-5ed98f9a-bbe0-463c-8607-57020ab99dbd tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208daa6413d34e4496e278fb3fc251a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba803ac5e71467f853215e19a7f8867', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:47.661639 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-5ed98f9a-bbe0-463c-8607-57020ab99dbd tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] 10.222.0.23 "GET /compute/v2.1/servers/9bed6256-fc6f-40dd-b465-54981581a6aa" status: 200 len: 1575 microversion: 2.1 time: 0.347102 Sep 09 16:38:47.679059 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 432/863] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:38:47 2022] GET /compute/v2.1/servers/9bed6256-fc6f-40dd-b465-54981581a6aa => generated 1575 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:38:47.685351 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [req-fe309a17-dd00-4ec7-b802-3dfc73868c43 req-ab7caee2-2d43-44bc-8725-659786919549 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e20f4f93-c27e-4971-a495-a3498f2611eb", "name": "network-vif-unplugged", "status": "completed", "tag": "8bab0b25-2131-47ef-88e3-210f0d9e7556"}]} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:38:47.714029 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-fe309a17-dd00-4ec7-b802-3dfc73868c43 req-ab7caee2-2d43-44bc-8725-659786919549 service nova] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:47.715063 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-fe309a17-dd00-4ec7-b802-3dfc73868c43 req-ab7caee2-2d43-44bc-8725-659786919549 service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:47.715732 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-fe309a17-dd00-4ec7-b802-3dfc73868c43 req-ab7caee2-2d43-44bc-8725-659786919549 service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:47.720122 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-589c994c-042b-42de-b00e-8b4141c64dab tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:47.731423 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-589c994c-042b-42de-b00e-8b4141c64dab tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:47.732930 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-589c994c-042b-42de-b00e-8b4141c64dab tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:47.734092 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-589c994c-042b-42de-b00e-8b4141c64dab tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb" status: 200 len: 1670 microversion: 2.20 time: 0.328929 Sep 09 16:38:47.735047 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.compute.server_external_events [req-fe309a17-dd00-4ec7-b802-3dfc73868c43 req-ab7caee2-2d43-44bc-8725-659786919549 service nova] Unable to find a host for instance e20f4f93-c27e-4971-a495-a3498f2611eb. Dropping event network-vif-unplugged {{(pid=127198) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 09 16:38:47.735170 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 432/864] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Sep 9 16:38:47 2022] GET /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb => generated 1670 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 16:38:47.736216 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [req-fe309a17-dd00-4ec7-b802-3dfc73868c43 req-ab7caee2-2d43-44bc-8725-659786919549 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.055689 Sep 09 16:38:47.736940 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 433/865] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Sep 9 16:38:47 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 57 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 09 16:38:48.691591 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-fd49751f-730d-427d-8457-471cf9070628 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:38:48.691591 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-fd49751f-730d-427d-8457-471cf9070628 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] [instance: 9bed6256-fc6f-40dd-b465-54981581a6aa] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:38:48.699367 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-fd49751f-730d-427d-8457-471cf9070628 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:48.699850 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-fd49751f-730d-427d-8457-471cf9070628 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:48.700282 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-fd49751f-730d-427d-8457-471cf9070628 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:48.704034 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-fd49751f-730d-427d-8457-471cf9070628 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:48.704510 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-fd49751f-730d-427d-8457-471cf9070628 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:48.704938 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-fd49751f-730d-427d-8457-471cf9070628 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:48.759716 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-ccdb5d68-88bb-4f4e-aa3e-2db013d5e72e tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:38:48.761395 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-ccdb5d68-88bb-4f4e-aa3e-2db013d5e72e tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: e20f4f93-c27e-4971-a495-a3498f2611eb] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:38:48.768787 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ccdb5d68-88bb-4f4e-aa3e-2db013d5e72e tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:48.769783 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ccdb5d68-88bb-4f4e-aa3e-2db013d5e72e tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:48.770383 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ccdb5d68-88bb-4f4e-aa3e-2db013d5e72e tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:48.771277 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ccdb5d68-88bb-4f4e-aa3e-2db013d5e72e tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:48.771992 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ccdb5d68-88bb-4f4e-aa3e-2db013d5e72e tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:48.772565 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ccdb5d68-88bb-4f4e-aa3e-2db013d5e72e tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:48.981386 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-fd49751f-730d-427d-8457-471cf9070628 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208daa6413d34e4496e278fb3fc251a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba803ac5e71467f853215e19a7f8867', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:48.981575 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-ccdb5d68-88bb-4f4e-aa3e-2db013d5e72e tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:49.000803 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-fd49751f-730d-427d-8457-471cf9070628 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] 10.222.0.23 "GET /compute/v2.1/servers/9bed6256-fc6f-40dd-b465-54981581a6aa" status: 200 len: 1575 microversion: 2.1 time: 0.313820 Sep 09 16:38:49.001694 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-ccdb5d68-88bb-4f4e-aa3e-2db013d5e72e tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:49.004371 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 433/866] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:38:48 2022] GET /compute/v2.1/servers/9bed6256-fc6f-40dd-b465-54981581a6aa => generated 1575 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:38:49.017596 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-ccdb5d68-88bb-4f4e-aa3e-2db013d5e72e tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:49.021359 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-ccdb5d68-88bb-4f4e-aa3e-2db013d5e72e tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb" status: 200 len: 1670 microversion: 2.20 time: 0.265532 Sep 09 16:38:49.026792 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 434/867] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Sep 9 16:38:48 2022] GET /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb => generated 1670 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 16:38:50.027950 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-35af6b98-02c4-4054-9503-2df3bd2e4b2d tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:38:50.028618 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-35af6b98-02c4-4054-9503-2df3bd2e4b2d tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] [instance: 9bed6256-fc6f-40dd-b465-54981581a6aa] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:38:50.035911 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-35af6b98-02c4-4054-9503-2df3bd2e4b2d tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:50.036395 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-35af6b98-02c4-4054-9503-2df3bd2e4b2d tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:50.036820 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-35af6b98-02c4-4054-9503-2df3bd2e4b2d tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:50.037509 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-35af6b98-02c4-4054-9503-2df3bd2e4b2d tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:50.038310 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-35af6b98-02c4-4054-9503-2df3bd2e4b2d tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:50.038747 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-35af6b98-02c4-4054-9503-2df3bd2e4b2d tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:50.051841 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-f1f61059-128c-49f9-8601-fa93021d0a5c tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:38:50.053486 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-f1f61059-128c-49f9-8601-fa93021d0a5c tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: e20f4f93-c27e-4971-a495-a3498f2611eb] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:38:50.068617 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f1f61059-128c-49f9-8601-fa93021d0a5c tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:50.069426 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f1f61059-128c-49f9-8601-fa93021d0a5c tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:50.070019 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f1f61059-128c-49f9-8601-fa93021d0a5c tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:50.070915 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f1f61059-128c-49f9-8601-fa93021d0a5c tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:50.071541 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f1f61059-128c-49f9-8601-fa93021d0a5c tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:50.072113 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f1f61059-128c-49f9-8601-fa93021d0a5c tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:50.284148 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-35af6b98-02c4-4054-9503-2df3bd2e4b2d tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208daa6413d34e4496e278fb3fc251a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba803ac5e71467f853215e19a7f8867', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:50.295667 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-35af6b98-02c4-4054-9503-2df3bd2e4b2d tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] 10.222.0.23 "GET /compute/v2.1/servers/9bed6256-fc6f-40dd-b465-54981581a6aa" status: 200 len: 1575 microversion: 2.1 time: 0.271494 Sep 09 16:38:50.296777 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 434/868] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:38:50 2022] GET /compute/v2.1/servers/9bed6256-fc6f-40dd-b465-54981581a6aa => generated 1575 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:38:50.330473 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-f1f61059-128c-49f9-8601-fa93021d0a5c tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:50.364977 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-f1f61059-128c-49f9-8601-fa93021d0a5c tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:50.369790 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-f1f61059-128c-49f9-8601-fa93021d0a5c tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:50.372856 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-f1f61059-128c-49f9-8601-fa93021d0a5c tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb" status: 200 len: 1728 microversion: 2.20 time: 0.325199 Sep 09 16:38:50.396314 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 435/869] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Sep 9 16:38:50 2022] GET /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb => generated 1728 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 16:38:51.320480 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-a9100acf-9e75-4f11-b74e-e1f850896f2f tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:38:51.322231 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-a9100acf-9e75-4f11-b74e-e1f850896f2f tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] [instance: 9bed6256-fc6f-40dd-b465-54981581a6aa] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:38:51.324941 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG dbcounter [-] [127196] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=127196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:38:51.330697 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-a9100acf-9e75-4f11-b74e-e1f850896f2f tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:51.331421 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-a9100acf-9e75-4f11-b74e-e1f850896f2f tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:51.331899 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-a9100acf-9e75-4f11-b74e-e1f850896f2f tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:51.332796 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-a9100acf-9e75-4f11-b74e-e1f850896f2f tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:51.333486 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-a9100acf-9e75-4f11-b74e-e1f850896f2f tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:51.334152 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-a9100acf-9e75-4f11-b74e-e1f850896f2f tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:51.405203 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-fd76bb32-a3df-4669-b525-8ab944c45895 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:38:51.406092 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-fd76bb32-a3df-4669-b525-8ab944c45895 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: e20f4f93-c27e-4971-a495-a3498f2611eb] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:38:51.413561 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_api:SELECT=81,nova_api:DELETE=1 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:38:51.415510 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fd76bb32-a3df-4669-b525-8ab944c45895 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:51.416398 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fd76bb32-a3df-4669-b525-8ab944c45895 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:51.417559 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fd76bb32-a3df-4669-b525-8ab944c45895 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:51.418914 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fd76bb32-a3df-4669-b525-8ab944c45895 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:51.419600 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fd76bb32-a3df-4669-b525-8ab944c45895 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:51.420108 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fd76bb32-a3df-4669-b525-8ab944c45895 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:51.703707 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-a9100acf-9e75-4f11-b74e-e1f850896f2f tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208daa6413d34e4496e278fb3fc251a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba803ac5e71467f853215e19a7f8867', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:51.710237 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG dbcounter [-] [127196] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=6,nova_cell1:INSERT=5 {{(pid=127196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:38:51.718219 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-a9100acf-9e75-4f11-b74e-e1f850896f2f tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] 10.222.0.23 "GET /compute/v2.1/servers/9bed6256-fc6f-40dd-b465-54981581a6aa" status: 200 len: 1575 microversion: 2.1 time: 0.400627 Sep 09 16:38:51.728998 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 435/870] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:38:51 2022] GET /compute/v2.1/servers/9bed6256-fc6f-40dd-b465-54981581a6aa => generated 1575 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:38:51.824243 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-fd76bb32-a3df-4669-b525-8ab944c45895 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:51.836425 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-fd76bb32-a3df-4669-b525-8ab944c45895 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:51.841283 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-fd76bb32-a3df-4669-b525-8ab944c45895 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:51.851589 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-fd76bb32-a3df-4669-b525-8ab944c45895 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb" status: 200 len: 1728 microversion: 2.20 time: 0.442695 Sep 09 16:38:51.852242 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 436/871] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Sep 9 16:38:51 2022] GET /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb => generated 1728 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 16:38:52.747777 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-471675dc-f132-443a-bbe6-2c389e8a1b9b tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:38:52.748627 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-471675dc-f132-443a-bbe6-2c389e8a1b9b tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] [instance: 9bed6256-fc6f-40dd-b465-54981581a6aa] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:38:52.756604 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-471675dc-f132-443a-bbe6-2c389e8a1b9b tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:52.757379 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-471675dc-f132-443a-bbe6-2c389e8a1b9b tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:52.758000 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-471675dc-f132-443a-bbe6-2c389e8a1b9b tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:52.758875 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-471675dc-f132-443a-bbe6-2c389e8a1b9b tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:52.759530 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-471675dc-f132-443a-bbe6-2c389e8a1b9b tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:52.759951 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-471675dc-f132-443a-bbe6-2c389e8a1b9b tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:52.881614 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-045cf1a4-744c-4238-89a6-1afbc38de16d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:38:52.882561 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-045cf1a4-744c-4238-89a6-1afbc38de16d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: e20f4f93-c27e-4971-a495-a3498f2611eb] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:38:52.897650 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-045cf1a4-744c-4238-89a6-1afbc38de16d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:52.902045 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-045cf1a4-744c-4238-89a6-1afbc38de16d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:52.902746 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-045cf1a4-744c-4238-89a6-1afbc38de16d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:52.903574 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-045cf1a4-744c-4238-89a6-1afbc38de16d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:52.904110 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-045cf1a4-744c-4238-89a6-1afbc38de16d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:52.904649 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-045cf1a4-744c-4238-89a6-1afbc38de16d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:53.077257 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-471675dc-f132-443a-bbe6-2c389e8a1b9b tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208daa6413d34e4496e278fb3fc251a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba803ac5e71467f853215e19a7f8867', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:53.089537 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-471675dc-f132-443a-bbe6-2c389e8a1b9b tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] 10.222.0.23 "GET /compute/v2.1/servers/9bed6256-fc6f-40dd-b465-54981581a6aa" status: 200 len: 1575 microversion: 2.1 time: 0.346751 Sep 09 16:38:53.112138 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 436/872] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:38:52 2022] GET /compute/v2.1/servers/9bed6256-fc6f-40dd-b465-54981581a6aa => generated 1575 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:38:53.121948 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-0e4e317e-c57d-450a-bb28-e5f0abe2412e tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0553db58-3699-4b99-8d81-04d4634d3805", "device": "/dev/sdb"}} {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:38:53.131746 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-0e4e317e-c57d-450a-bb28-e5f0abe2412e tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] [instance: ce8ce7fc-5de7-4d65-b26b-e1a60b59f8a1] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:38:53.153364 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-0e4e317e-c57d-450a-bb28-e5f0abe2412e tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:53.153857 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-0e4e317e-c57d-450a-bb28-e5f0abe2412e tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:53.178009 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-0e4e317e-c57d-450a-bb28-e5f0abe2412e tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:53.181458 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-0e4e317e-c57d-450a-bb28-e5f0abe2412e tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:53.183628 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-0e4e317e-c57d-450a-bb28-e5f0abe2412e tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:53.184097 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-0e4e317e-c57d-450a-bb28-e5f0abe2412e tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:53.341837 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-045cf1a4-744c-4238-89a6-1afbc38de16d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:53.351308 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-045cf1a4-744c-4238-89a6-1afbc38de16d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:53.356324 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-045cf1a4-744c-4238-89a6-1afbc38de16d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:53.357540 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-045cf1a4-744c-4238-89a6-1afbc38de16d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb" status: 200 len: 1728 microversion: 2.20 time: 0.481710 Sep 09 16:38:53.381455 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 437/873] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Sep 9 16:38:52 2022] GET /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb => generated 1728 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 16:38:54.122134 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-3305cf84-1660-4b2f-840a-ff72284a66f8 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:38:54.123335 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-3305cf84-1660-4b2f-840a-ff72284a66f8 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] [instance: 9bed6256-fc6f-40dd-b465-54981581a6aa] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:38:54.140244 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3305cf84-1660-4b2f-840a-ff72284a66f8 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:54.141042 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3305cf84-1660-4b2f-840a-ff72284a66f8 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:54.141718 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3305cf84-1660-4b2f-840a-ff72284a66f8 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:54.146254 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3305cf84-1660-4b2f-840a-ff72284a66f8 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:54.147084 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3305cf84-1660-4b2f-840a-ff72284a66f8 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:54.147722 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3305cf84-1660-4b2f-840a-ff72284a66f8 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:54.558743 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-3305cf84-1660-4b2f-840a-ff72284a66f8 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208daa6413d34e4496e278fb3fc251a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba803ac5e71467f853215e19a7f8867', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:54.570102 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-3305cf84-1660-4b2f-840a-ff72284a66f8 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] 10.222.0.23 "GET /compute/v2.1/servers/9bed6256-fc6f-40dd-b465-54981581a6aa" status: 200 len: 1575 microversion: 2.1 time: 0.453762 Sep 09 16:38:54.586144 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 438/874] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:38:54 2022] GET /compute/v2.1/servers/9bed6256-fc6f-40dd-b465-54981581a6aa => generated 1575 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 16:38:54.591616 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-662ad150-8583-4a14-8746-c25437c9086d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:38:54.592487 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-662ad150-8583-4a14-8746-c25437c9086d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: e20f4f93-c27e-4971-a495-a3498f2611eb] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:38:54.600615 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-662ad150-8583-4a14-8746-c25437c9086d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:54.601378 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-662ad150-8583-4a14-8746-c25437c9086d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:54.602074 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-662ad150-8583-4a14-8746-c25437c9086d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:54.603074 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-662ad150-8583-4a14-8746-c25437c9086d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:54.603797 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-662ad150-8583-4a14-8746-c25437c9086d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:54.604452 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-662ad150-8583-4a14-8746-c25437c9086d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:54.922918 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-662ad150-8583-4a14-8746-c25437c9086d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:54.936192 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-662ad150-8583-4a14-8746-c25437c9086d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:54.940035 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-662ad150-8583-4a14-8746-c25437c9086d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:54.950892 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-662ad150-8583-4a14-8746-c25437c9086d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb" status: 200 len: 1728 microversion: 2.20 time: 0.362576 Sep 09 16:38:54.952973 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 439/875] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Sep 9 16:38:54 2022] GET /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb => generated 1728 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 16:38:55.594100 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-496ee698-cea0-4852-9052-dd7f2b4bf73d tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:38:55.594991 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-496ee698-cea0-4852-9052-dd7f2b4bf73d tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] [instance: 9bed6256-fc6f-40dd-b465-54981581a6aa] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:38:55.604169 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-496ee698-cea0-4852-9052-dd7f2b4bf73d tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:55.604667 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-496ee698-cea0-4852-9052-dd7f2b4bf73d tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:55.605539 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-496ee698-cea0-4852-9052-dd7f2b4bf73d tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:55.606254 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-496ee698-cea0-4852-9052-dd7f2b4bf73d tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:55.606756 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-496ee698-cea0-4852-9052-dd7f2b4bf73d tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:55.607438 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-496ee698-cea0-4852-9052-dd7f2b4bf73d tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:56.017982 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-496ee698-cea0-4852-9052-dd7f2b4bf73d tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208daa6413d34e4496e278fb3fc251a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba803ac5e71467f853215e19a7f8867', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:56.031109 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-496ee698-cea0-4852-9052-dd7f2b4bf73d tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] 10.222.0.23 "GET /compute/v2.1/servers/9bed6256-fc6f-40dd-b465-54981581a6aa" status: 200 len: 1575 microversion: 2.1 time: 0.437701 Sep 09 16:38:56.046958 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 440/876] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:38:55 2022] GET /compute/v2.1/servers/9bed6256-fc6f-40dd-b465-54981581a6aa => generated 1575 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:38:56.068528 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-522f7c3f-3dff-453c-8c0a-bb69c0e37193 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:38:56.072406 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-522f7c3f-3dff-453c-8c0a-bb69c0e37193 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: e20f4f93-c27e-4971-a495-a3498f2611eb] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:38:56.081946 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-522f7c3f-3dff-453c-8c0a-bb69c0e37193 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:56.082978 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-522f7c3f-3dff-453c-8c0a-bb69c0e37193 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:56.083645 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-522f7c3f-3dff-453c-8c0a-bb69c0e37193 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:56.084580 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-522f7c3f-3dff-453c-8c0a-bb69c0e37193 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:56.085417 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-522f7c3f-3dff-453c-8c0a-bb69c0e37193 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:56.086010 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-522f7c3f-3dff-453c-8c0a-bb69c0e37193 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:56.469554 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-522f7c3f-3dff-453c-8c0a-bb69c0e37193 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:56.483877 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-522f7c3f-3dff-453c-8c0a-bb69c0e37193 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:56.486934 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-522f7c3f-3dff-453c-8c0a-bb69c0e37193 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:56.497755 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-522f7c3f-3dff-453c-8c0a-bb69c0e37193 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb" status: 200 len: 1728 microversion: 2.20 time: 0.451018 Sep 09 16:38:56.498415 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 441/877] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Sep 9 16:38:56 2022] GET /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb => generated 1728 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 16:38:57.057005 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-247d0370-12c1-4e5f-9aa2-7f85e2316864 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:38:57.062885 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-247d0370-12c1-4e5f-9aa2-7f85e2316864 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] [instance: 9bed6256-fc6f-40dd-b465-54981581a6aa] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:38:57.098483 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-247d0370-12c1-4e5f-9aa2-7f85e2316864 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:57.104731 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-247d0370-12c1-4e5f-9aa2-7f85e2316864 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:57.108339 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-247d0370-12c1-4e5f-9aa2-7f85e2316864 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:57.110987 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-247d0370-12c1-4e5f-9aa2-7f85e2316864 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:57.113744 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-247d0370-12c1-4e5f-9aa2-7f85e2316864 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:57.116159 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-247d0370-12c1-4e5f-9aa2-7f85e2316864 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:57.734473 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-247d0370-12c1-4e5f-9aa2-7f85e2316864 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208daa6413d34e4496e278fb3fc251a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba803ac5e71467f853215e19a7f8867', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:57.747967 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-247d0370-12c1-4e5f-9aa2-7f85e2316864 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] 10.222.0.23 "GET /compute/v2.1/servers/9bed6256-fc6f-40dd-b465-54981581a6aa" status: 200 len: 1575 microversion: 2.1 time: 0.692534 Sep 09 16:38:57.763763 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 442/878] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:38:57 2022] GET /compute/v2.1/servers/9bed6256-fc6f-40dd-b465-54981581a6aa => generated 1575 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:38:57.766615 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-7a89035a-cd3a-4a3d-b435-3ea41d911035 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:38:57.769372 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-7a89035a-cd3a-4a3d-b435-3ea41d911035 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: e20f4f93-c27e-4971-a495-a3498f2611eb] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:38:57.805209 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7a89035a-cd3a-4a3d-b435-3ea41d911035 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:57.805783 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7a89035a-cd3a-4a3d-b435-3ea41d911035 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:57.806126 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7a89035a-cd3a-4a3d-b435-3ea41d911035 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:57.806891 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7a89035a-cd3a-4a3d-b435-3ea41d911035 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:57.807345 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7a89035a-cd3a-4a3d-b435-3ea41d911035 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:57.807872 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7a89035a-cd3a-4a3d-b435-3ea41d911035 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:58.193603 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-7a89035a-cd3a-4a3d-b435-3ea41d911035 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:58.203192 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-7a89035a-cd3a-4a3d-b435-3ea41d911035 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:58.211178 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-7a89035a-cd3a-4a3d-b435-3ea41d911035 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:58.212953 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-7a89035a-cd3a-4a3d-b435-3ea41d911035 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb" status: 200 len: 1728 microversion: 2.20 time: 0.453161 Sep 09 16:38:58.213826 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 443/879] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Sep 9 16:38:57 2022] GET /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb => generated 1728 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 16:38:58.775758 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-71065531-7b94-4f73-b930-6d91a841f582 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:38:58.776658 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-71065531-7b94-4f73-b930-6d91a841f582 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] [instance: 9bed6256-fc6f-40dd-b465-54981581a6aa] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:38:58.784077 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-71065531-7b94-4f73-b930-6d91a841f582 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:58.784660 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-71065531-7b94-4f73-b930-6d91a841f582 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:58.784989 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-71065531-7b94-4f73-b930-6d91a841f582 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:58.785697 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-71065531-7b94-4f73-b930-6d91a841f582 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:58.786154 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-71065531-7b94-4f73-b930-6d91a841f582 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:58.786612 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-71065531-7b94-4f73-b930-6d91a841f582 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:59.022899 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-71065531-7b94-4f73-b930-6d91a841f582 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208daa6413d34e4496e278fb3fc251a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba803ac5e71467f853215e19a7f8867', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:59.033262 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-71065531-7b94-4f73-b930-6d91a841f582 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] 10.222.0.23 "GET /compute/v2.1/servers/9bed6256-fc6f-40dd-b465-54981581a6aa" status: 200 len: 1575 microversion: 2.1 time: 0.261401 Sep 09 16:38:59.049793 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 444/880] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:38:58 2022] GET /compute/v2.1/servers/9bed6256-fc6f-40dd-b465-54981581a6aa => generated 1575 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 16:38:59.241823 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-a63ec8b1-56e3-492b-a62f-458b9867431a tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:38:59.242657 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-a63ec8b1-56e3-492b-a62f-458b9867431a tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: e20f4f93-c27e-4971-a495-a3498f2611eb] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:38:59.254836 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a63ec8b1-56e3-492b-a62f-458b9867431a tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:59.255373 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a63ec8b1-56e3-492b-a62f-458b9867431a tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:59.255876 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a63ec8b1-56e3-492b-a62f-458b9867431a tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:59.256555 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a63ec8b1-56e3-492b-a62f-458b9867431a tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:38:59.258683 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a63ec8b1-56e3-492b-a62f-458b9867431a tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:38:59.259297 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a63ec8b1-56e3-492b-a62f-458b9867431a tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:38:59.265259 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:38:59.629012 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-a63ec8b1-56e3-492b-a62f-458b9867431a tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:59.645807 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-a63ec8b1-56e3-492b-a62f-458b9867431a tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:59.655326 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-a63ec8b1-56e3-492b-a62f-458b9867431a tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:38:59.661395 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-a63ec8b1-56e3-492b-a62f-458b9867431a tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb" status: 200 len: 1728 microversion: 2.20 time: 0.422898 Sep 09 16:38:59.663561 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 445/881] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Sep 9 16:38:59 2022] GET /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb => generated 1728 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 16:39:00.057677 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-13d58722-91a5-435c-96ba-06d7c4ce7fea tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:39:00.058357 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-13d58722-91a5-435c-96ba-06d7c4ce7fea tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] [instance: 9bed6256-fc6f-40dd-b465-54981581a6aa] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:39:00.066613 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-13d58722-91a5-435c-96ba-06d7c4ce7fea tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:00.069598 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-13d58722-91a5-435c-96ba-06d7c4ce7fea tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:00.070116 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-13d58722-91a5-435c-96ba-06d7c4ce7fea tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:00.071170 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-13d58722-91a5-435c-96ba-06d7c4ce7fea tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:00.071644 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-13d58722-91a5-435c-96ba-06d7c4ce7fea tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:00.072059 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-13d58722-91a5-435c-96ba-06d7c4ce7fea tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:00.451420 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-13d58722-91a5-435c-96ba-06d7c4ce7fea tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208daa6413d34e4496e278fb3fc251a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba803ac5e71467f853215e19a7f8867', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:39:00.469992 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-13d58722-91a5-435c-96ba-06d7c4ce7fea tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] 10.222.0.23 "GET /compute/v2.1/servers/9bed6256-fc6f-40dd-b465-54981581a6aa" status: 200 len: 1575 microversion: 2.1 time: 0.416739 Sep 09 16:39:00.475539 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 446/882] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:39:00 2022] GET /compute/v2.1/servers/9bed6256-fc6f-40dd-b465-54981581a6aa => generated 1575 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 16:39:00.698264 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-be7235b0-3bb7-4379-8168-6289ac59e9e1 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:39:00.699090 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-be7235b0-3bb7-4379-8168-6289ac59e9e1 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: e20f4f93-c27e-4971-a495-a3498f2611eb] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:39:00.722521 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-be7235b0-3bb7-4379-8168-6289ac59e9e1 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:00.725901 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-be7235b0-3bb7-4379-8168-6289ac59e9e1 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:00.727246 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-be7235b0-3bb7-4379-8168-6289ac59e9e1 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:00.731209 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-be7235b0-3bb7-4379-8168-6289ac59e9e1 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:00.732637 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-be7235b0-3bb7-4379-8168-6289ac59e9e1 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:00.735972 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-be7235b0-3bb7-4379-8168-6289ac59e9e1 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:01.147634 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-be7235b0-3bb7-4379-8168-6289ac59e9e1 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:39:01.166428 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-be7235b0-3bb7-4379-8168-6289ac59e9e1 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:39:01.169970 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-be7235b0-3bb7-4379-8168-6289ac59e9e1 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:39:01.173636 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-be7235b0-3bb7-4379-8168-6289ac59e9e1 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb" status: 200 len: 1728 microversion: 2.20 time: 0.481698 Sep 09 16:39:01.174339 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 447/883] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Sep 9 16:39:00 2022] GET /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb => generated 1728 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 16:39:01.503320 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-8f14571b-0f4b-48bb-9e3a-05aea4d47d10 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:39:01.504583 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-8f14571b-0f4b-48bb-9e3a-05aea4d47d10 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] [instance: 9bed6256-fc6f-40dd-b465-54981581a6aa] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:39:01.529009 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8f14571b-0f4b-48bb-9e3a-05aea4d47d10 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:01.533515 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8f14571b-0f4b-48bb-9e3a-05aea4d47d10 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:01.534088 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8f14571b-0f4b-48bb-9e3a-05aea4d47d10 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:01.534928 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8f14571b-0f4b-48bb-9e3a-05aea4d47d10 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:01.536268 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8f14571b-0f4b-48bb-9e3a-05aea4d47d10 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:01.538403 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8f14571b-0f4b-48bb-9e3a-05aea4d47d10 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:01.854993 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-8f14571b-0f4b-48bb-9e3a-05aea4d47d10 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208daa6413d34e4496e278fb3fc251a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba803ac5e71467f853215e19a7f8867', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:39:01.865684 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-8f14571b-0f4b-48bb-9e3a-05aea4d47d10 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] 10.222.0.23 "GET /compute/v2.1/servers/9bed6256-fc6f-40dd-b465-54981581a6aa" status: 200 len: 1575 microversion: 2.1 time: 0.368070 Sep 09 16:39:01.868041 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 448/884] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:39:01 2022] GET /compute/v2.1/servers/9bed6256-fc6f-40dd-b465-54981581a6aa => generated 1575 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:39:02.200684 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-7480c96d-717c-4140-a376-2fa6939e099b tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:39:02.201840 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-7480c96d-717c-4140-a376-2fa6939e099b tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: e20f4f93-c27e-4971-a495-a3498f2611eb] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:39:02.211587 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7480c96d-717c-4140-a376-2fa6939e099b tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:02.212241 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7480c96d-717c-4140-a376-2fa6939e099b tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:02.212794 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7480c96d-717c-4140-a376-2fa6939e099b tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:02.213646 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7480c96d-717c-4140-a376-2fa6939e099b tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:02.214343 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7480c96d-717c-4140-a376-2fa6939e099b tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:02.219747 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7480c96d-717c-4140-a376-2fa6939e099b tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:02.426644 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-7480c96d-717c-4140-a376-2fa6939e099b tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:39:02.435544 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-7480c96d-717c-4140-a376-2fa6939e099b tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:39:02.436997 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-7480c96d-717c-4140-a376-2fa6939e099b tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:39:02.438180 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-7480c96d-717c-4140-a376-2fa6939e099b tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb" status: 200 len: 1728 microversion: 2.20 time: 0.242775 Sep 09 16:39:02.438956 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 449/885] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Sep 9 16:39:02 2022] GET /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb => generated 1728 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 16:39:02.763110 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-0e4e317e-c57d-450a-bb28-e5f0abe2412e tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] 10.222.0.23 "POST /compute/v2.1/servers/ce8ce7fc-5de7-4d65-b26b-e1a60b59f8a1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 9.645958 Sep 09 16:39:02.764884 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 437/886] 10.222.0.23 () {60 vars in 1323 bytes} [Fri Sep 9 16:38:53 2022] POST /compute/v2.1/servers/ce8ce7fc-5de7-4d65-b26b-e1a60b59f8a1/os-volume_attachments => generated 194 bytes in 9649 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:39:02.892608 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-642cb6f8-3c1f-4ee4-9980-3e6818239d29 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:39:02.893935 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-642cb6f8-3c1f-4ee4-9980-3e6818239d29 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] [instance: 9bed6256-fc6f-40dd-b465-54981581a6aa] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:39:02.905533 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-642cb6f8-3c1f-4ee4-9980-3e6818239d29 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:02.906316 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-642cb6f8-3c1f-4ee4-9980-3e6818239d29 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:02.907080 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-642cb6f8-3c1f-4ee4-9980-3e6818239d29 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:02.908061 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-642cb6f8-3c1f-4ee4-9980-3e6818239d29 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:02.908680 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-642cb6f8-3c1f-4ee4-9980-3e6818239d29 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:02.909256 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-642cb6f8-3c1f-4ee4-9980-3e6818239d29 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:03.099022 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-642cb6f8-3c1f-4ee4-9980-3e6818239d29 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208daa6413d34e4496e278fb3fc251a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba803ac5e71467f853215e19a7f8867', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:39:03.112489 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-642cb6f8-3c1f-4ee4-9980-3e6818239d29 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] 10.222.0.23 "GET /compute/v2.1/servers/9bed6256-fc6f-40dd-b465-54981581a6aa" status: 200 len: 1575 microversion: 2.1 time: 0.225186 Sep 09 16:39:03.114168 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 450/887] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:39:02 2022] GET /compute/v2.1/servers/9bed6256-fc6f-40dd-b465-54981581a6aa => generated 1575 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:39:03.465804 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-bc4c22fd-605e-4aa6-b245-619a91968209 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:39:03.466704 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-bc4c22fd-605e-4aa6-b245-619a91968209 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: e20f4f93-c27e-4971-a495-a3498f2611eb] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:39:03.469108 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG dbcounter [-] [127196] Writing DB stats nova_api:SELECT=5 {{(pid=127196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:39:03.475733 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-bc4c22fd-605e-4aa6-b245-619a91968209 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:03.476543 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-bc4c22fd-605e-4aa6-b245-619a91968209 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:03.477272 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-bc4c22fd-605e-4aa6-b245-619a91968209 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:03.478489 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-bc4c22fd-605e-4aa6-b245-619a91968209 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:03.479289 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-bc4c22fd-605e-4aa6-b245-619a91968209 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:03.479977 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-bc4c22fd-605e-4aa6-b245-619a91968209 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:03.661089 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-bc4c22fd-605e-4aa6-b245-619a91968209 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:39:03.675611 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-bc4c22fd-605e-4aa6-b245-619a91968209 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:39:03.677629 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-bc4c22fd-605e-4aa6-b245-619a91968209 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:39:03.679193 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-bc4c22fd-605e-4aa6-b245-619a91968209 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb" status: 200 len: 1728 microversion: 2.20 time: 0.218027 Sep 09 16:39:03.680041 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 438/888] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Sep 9 16:39:03 2022] GET /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb => generated 1728 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 16:39:04.138075 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-ef8a156c-905b-416f-b0b6-961ddac76a22 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:39:04.139006 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-ef8a156c-905b-416f-b0b6-961ddac76a22 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] [instance: 9bed6256-fc6f-40dd-b465-54981581a6aa] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:39:04.146115 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ef8a156c-905b-416f-b0b6-961ddac76a22 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:04.146764 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ef8a156c-905b-416f-b0b6-961ddac76a22 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:04.147479 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ef8a156c-905b-416f-b0b6-961ddac76a22 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:04.148427 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ef8a156c-905b-416f-b0b6-961ddac76a22 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:04.149957 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ef8a156c-905b-416f-b0b6-961ddac76a22 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:04.150887 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ef8a156c-905b-416f-b0b6-961ddac76a22 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:04.413636 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-ef8a156c-905b-416f-b0b6-961ddac76a22 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208daa6413d34e4496e278fb3fc251a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba803ac5e71467f853215e19a7f8867', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:39:04.424954 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-ef8a156c-905b-416f-b0b6-961ddac76a22 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] 10.222.0.23 "GET /compute/v2.1/servers/9bed6256-fc6f-40dd-b465-54981581a6aa" status: 200 len: 1575 microversion: 2.1 time: 0.292606 Sep 09 16:39:04.425535 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 451/889] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:39:04 2022] GET /compute/v2.1/servers/9bed6256-fc6f-40dd-b465-54981581a6aa => generated 1575 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:39:04.706987 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-d946db48-3a76-48c3-9b2a-42c4799a666b tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:39:04.708332 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-d946db48-3a76-48c3-9b2a-42c4799a666b tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: e20f4f93-c27e-4971-a495-a3498f2611eb] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:39:04.716911 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-d946db48-3a76-48c3-9b2a-42c4799a666b tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:04.717647 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-d946db48-3a76-48c3-9b2a-42c4799a666b tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:04.718244 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-d946db48-3a76-48c3-9b2a-42c4799a666b tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:04.719134 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-d946db48-3a76-48c3-9b2a-42c4799a666b tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:04.719964 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-d946db48-3a76-48c3-9b2a-42c4799a666b tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:04.721982 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-d946db48-3a76-48c3-9b2a-42c4799a666b tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:04.905203 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-d946db48-3a76-48c3-9b2a-42c4799a666b tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:39:04.915556 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-d946db48-3a76-48c3-9b2a-42c4799a666b tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:39:04.918386 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-d946db48-3a76-48c3-9b2a-42c4799a666b tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:39:04.919731 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-d946db48-3a76-48c3-9b2a-42c4799a666b tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb" status: 200 len: 1728 microversion: 2.20 time: 0.217734 Sep 09 16:39:04.920234 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 439/890] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Sep 9 16:39:04 2022] GET /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb => generated 1728 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 16:39:05.449403 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-e16c8034-f355-45ce-9af4-57a3fd8c7506 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:39:05.450224 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-e16c8034-f355-45ce-9af4-57a3fd8c7506 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] [instance: 9bed6256-fc6f-40dd-b465-54981581a6aa] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:39:05.457319 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e16c8034-f355-45ce-9af4-57a3fd8c7506 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:05.457811 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e16c8034-f355-45ce-9af4-57a3fd8c7506 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:05.458245 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e16c8034-f355-45ce-9af4-57a3fd8c7506 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:05.458995 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e16c8034-f355-45ce-9af4-57a3fd8c7506 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:05.459453 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e16c8034-f355-45ce-9af4-57a3fd8c7506 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:05.459882 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e16c8034-f355-45ce-9af4-57a3fd8c7506 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:05.650651 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-e16c8034-f355-45ce-9af4-57a3fd8c7506 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208daa6413d34e4496e278fb3fc251a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba803ac5e71467f853215e19a7f8867', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:39:05.661178 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-e16c8034-f355-45ce-9af4-57a3fd8c7506 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] 10.222.0.23 "GET /compute/v2.1/servers/9bed6256-fc6f-40dd-b465-54981581a6aa" status: 200 len: 1575 microversion: 2.1 time: 0.215874 Sep 09 16:39:05.663360 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 452/891] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:39:05 2022] GET /compute/v2.1/servers/9bed6256-fc6f-40dd-b465-54981581a6aa => generated 1575 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:39:05.945898 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-deadf693-65ca-40dd-b3b3-2dd49e3bfb51 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:39:05.947179 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-deadf693-65ca-40dd-b3b3-2dd49e3bfb51 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: e20f4f93-c27e-4971-a495-a3498f2611eb] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:39:05.959151 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-deadf693-65ca-40dd-b3b3-2dd49e3bfb51 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:05.960076 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-deadf693-65ca-40dd-b3b3-2dd49e3bfb51 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:05.960760 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-deadf693-65ca-40dd-b3b3-2dd49e3bfb51 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:05.961511 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-deadf693-65ca-40dd-b3b3-2dd49e3bfb51 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:05.961969 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-deadf693-65ca-40dd-b3b3-2dd49e3bfb51 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:05.962390 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-deadf693-65ca-40dd-b3b3-2dd49e3bfb51 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:06.245454 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-deadf693-65ca-40dd-b3b3-2dd49e3bfb51 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:39:06.258777 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-deadf693-65ca-40dd-b3b3-2dd49e3bfb51 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:39:06.260844 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-deadf693-65ca-40dd-b3b3-2dd49e3bfb51 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:39:06.262535 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-deadf693-65ca-40dd-b3b3-2dd49e3bfb51 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb" status: 200 len: 1728 microversion: 2.20 time: 0.320899 Sep 09 16:39:06.263043 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 440/892] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Sep 9 16:39:05 2022] GET /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb => generated 1728 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 16:39:06.691994 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-1ac08a82-a37f-4211-ad4c-c6b87adf0caa tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:39:06.692604 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-1ac08a82-a37f-4211-ad4c-c6b87adf0caa tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] [instance: 9bed6256-fc6f-40dd-b465-54981581a6aa] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:39:06.701005 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1ac08a82-a37f-4211-ad4c-c6b87adf0caa tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:06.701744 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1ac08a82-a37f-4211-ad4c-c6b87adf0caa tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:06.702364 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1ac08a82-a37f-4211-ad4c-c6b87adf0caa tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:06.703275 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1ac08a82-a37f-4211-ad4c-c6b87adf0caa tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:06.703730 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1ac08a82-a37f-4211-ad4c-c6b87adf0caa tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:06.704147 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1ac08a82-a37f-4211-ad4c-c6b87adf0caa tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:06.897111 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-1ac08a82-a37f-4211-ad4c-c6b87adf0caa tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208daa6413d34e4496e278fb3fc251a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba803ac5e71467f853215e19a7f8867', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:39:06.908105 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-1ac08a82-a37f-4211-ad4c-c6b87adf0caa tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] 10.222.0.23 "GET /compute/v2.1/servers/9bed6256-fc6f-40dd-b465-54981581a6aa" status: 200 len: 1575 microversion: 2.1 time: 0.219933 Sep 09 16:39:06.911362 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 453/893] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:39:06 2022] GET /compute/v2.1/servers/9bed6256-fc6f-40dd-b465-54981581a6aa => generated 1575 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:39:07.297004 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-838a8aba-a555-4d9a-a47b-e0038a9449da tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:39:07.298106 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-838a8aba-a555-4d9a-a47b-e0038a9449da tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: e20f4f93-c27e-4971-a495-a3498f2611eb] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:39:07.307505 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-838a8aba-a555-4d9a-a47b-e0038a9449da tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:07.308207 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-838a8aba-a555-4d9a-a47b-e0038a9449da tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:07.309224 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-838a8aba-a555-4d9a-a47b-e0038a9449da tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:07.310175 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-838a8aba-a555-4d9a-a47b-e0038a9449da tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:07.310748 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-838a8aba-a555-4d9a-a47b-e0038a9449da tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:07.311289 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-838a8aba-a555-4d9a-a47b-e0038a9449da tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:07.481838 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-838a8aba-a555-4d9a-a47b-e0038a9449da tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:39:07.497377 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-838a8aba-a555-4d9a-a47b-e0038a9449da tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:39:07.499661 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-838a8aba-a555-4d9a-a47b-e0038a9449da tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:39:07.501600 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-838a8aba-a555-4d9a-a47b-e0038a9449da tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb" status: 200 len: 1728 microversion: 2.20 time: 0.211939 Sep 09 16:39:07.502965 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 441/894] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Sep 9 16:39:07 2022] GET /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb => generated 1728 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 16:39:07.654150 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [req-8c3ff53e-fd39-4e44-9a37-e0a476e30680 req-b4493b60-c1f4-45fc-8512-fa7207dc8cdc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bed6256-fc6f-40dd-b465-54981581a6aa", "name": "network-vif-plugged", "status": "completed", "tag": "7151e062-a48c-4cc1-be6e-dbf4d66de6e4"}]} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:39:07.675983 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-8c3ff53e-fd39-4e44-9a37-e0a476e30680 req-b4493b60-c1f4-45fc-8512-fa7207dc8cdc service nova] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:07.677170 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-8c3ff53e-fd39-4e44-9a37-e0a476e30680 req-b4493b60-c1f4-45fc-8512-fa7207dc8cdc service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:07.677829 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-8c3ff53e-fd39-4e44-9a37-e0a476e30680 req-b4493b60-c1f4-45fc-8512-fa7207dc8cdc service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:07.694193 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.compute.server_external_events [req-8c3ff53e-fd39-4e44-9a37-e0a476e30680 req-b4493b60-c1f4-45fc-8512-fa7207dc8cdc service nova] Creating event network-vif-plugged:7151e062-a48c-4cc1-be6e-dbf4d66de6e4 for instance 9bed6256-fc6f-40dd-b465-54981581a6aa on hv-cinder-83124 Sep 09 16:39:07.701440 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [req-8c3ff53e-fd39-4e44-9a37-e0a476e30680 req-b4493b60-c1f4-45fc-8512-fa7207dc8cdc service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053377 Sep 09 16:39:07.702416 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 454/895] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Sep 9 16:39:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:39:07.936038 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-0cd7f561-4b7b-4cdc-a01a-f20c65b82499 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:39:07.936924 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-0cd7f561-4b7b-4cdc-a01a-f20c65b82499 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] [instance: 9bed6256-fc6f-40dd-b465-54981581a6aa] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:39:07.945802 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-0cd7f561-4b7b-4cdc-a01a-f20c65b82499 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:07.946764 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-0cd7f561-4b7b-4cdc-a01a-f20c65b82499 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:07.947512 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-0cd7f561-4b7b-4cdc-a01a-f20c65b82499 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:07.948388 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-0cd7f561-4b7b-4cdc-a01a-f20c65b82499 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:07.948993 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-0cd7f561-4b7b-4cdc-a01a-f20c65b82499 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:07.949565 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-0cd7f561-4b7b-4cdc-a01a-f20c65b82499 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:08.166836 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-0cd7f561-4b7b-4cdc-a01a-f20c65b82499 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208daa6413d34e4496e278fb3fc251a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba803ac5e71467f853215e19a7f8867', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:39:08.176993 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-0cd7f561-4b7b-4cdc-a01a-f20c65b82499 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] 10.222.0.23 "GET /compute/v2.1/servers/9bed6256-fc6f-40dd-b465-54981581a6aa" status: 200 len: 1575 microversion: 2.1 time: 0.245841 Sep 09 16:39:08.177586 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 442/896] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:39:07 2022] GET /compute/v2.1/servers/9bed6256-fc6f-40dd-b465-54981581a6aa => generated 1575 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:39:08.532419 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-7fb4a878-fa9d-43aa-ac47-e7c31f2509d2 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:39:08.534388 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-7fb4a878-fa9d-43aa-ac47-e7c31f2509d2 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: e20f4f93-c27e-4971-a495-a3498f2611eb] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:39:08.543273 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7fb4a878-fa9d-43aa-ac47-e7c31f2509d2 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:08.543881 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7fb4a878-fa9d-43aa-ac47-e7c31f2509d2 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:08.544418 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7fb4a878-fa9d-43aa-ac47-e7c31f2509d2 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:08.545247 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7fb4a878-fa9d-43aa-ac47-e7c31f2509d2 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:08.545795 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7fb4a878-fa9d-43aa-ac47-e7c31f2509d2 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:08.546425 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7fb4a878-fa9d-43aa-ac47-e7c31f2509d2 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:08.734115 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-7fb4a878-fa9d-43aa-ac47-e7c31f2509d2 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:39:08.750163 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-7fb4a878-fa9d-43aa-ac47-e7c31f2509d2 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:39:08.751646 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-7fb4a878-fa9d-43aa-ac47-e7c31f2509d2 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:39:08.752837 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-7fb4a878-fa9d-43aa-ac47-e7c31f2509d2 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb" status: 200 len: 1728 microversion: 2.20 time: 0.227232 Sep 09 16:39:08.753369 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 455/897] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Sep 9 16:39:08 2022] GET /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb => generated 1728 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 16:39:09.202580 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-f3a2826d-68cd-44d9-a057-0dee90916f16 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:39:09.203218 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-f3a2826d-68cd-44d9-a057-0dee90916f16 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] [instance: 9bed6256-fc6f-40dd-b465-54981581a6aa] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:39:09.210431 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f3a2826d-68cd-44d9-a057-0dee90916f16 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:09.211636 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f3a2826d-68cd-44d9-a057-0dee90916f16 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:09.212255 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f3a2826d-68cd-44d9-a057-0dee90916f16 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:09.213063 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f3a2826d-68cd-44d9-a057-0dee90916f16 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:09.213540 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f3a2826d-68cd-44d9-a057-0dee90916f16 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:09.213957 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f3a2826d-68cd-44d9-a057-0dee90916f16 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:09.400524 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-f3a2826d-68cd-44d9-a057-0dee90916f16 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208daa6413d34e4496e278fb3fc251a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba803ac5e71467f853215e19a7f8867', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:39:09.411358 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-f3a2826d-68cd-44d9-a057-0dee90916f16 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] 10.222.0.23 "GET /compute/v2.1/servers/9bed6256-fc6f-40dd-b465-54981581a6aa" status: 200 len: 1575 microversion: 2.1 time: 0.212681 Sep 09 16:39:09.413343 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 443/898] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:39:09 2022] GET /compute/v2.1/servers/9bed6256-fc6f-40dd-b465-54981581a6aa => generated 1575 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:39:09.746997 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [req-510493f0-2d95-44f7-8e15-3d429e549753 req-650194a3-d4f7-4fdc-ab8c-ab3dd5865456 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e20f4f93-c27e-4971-a495-a3498f2611eb", "name": "network-vif-plugged", "status": "completed", "tag": "8bab0b25-2131-47ef-88e3-210f0d9e7556"}]} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:39:09.765544 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-510493f0-2d95-44f7-8e15-3d429e549753 req-650194a3-d4f7-4fdc-ab8c-ab3dd5865456 service nova] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:09.766024 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-510493f0-2d95-44f7-8e15-3d429e549753 req-650194a3-d4f7-4fdc-ab8c-ab3dd5865456 service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:09.766444 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-510493f0-2d95-44f7-8e15-3d429e549753 req-650194a3-d4f7-4fdc-ab8c-ab3dd5865456 service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:09.781401 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-fdd0b67a-01c8-421f-bd65-c90438d4f768 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:39:09.781736 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-fdd0b67a-01c8-421f-bd65-c90438d4f768 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: e20f4f93-c27e-4971-a495-a3498f2611eb] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:39:09.792693 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-fdd0b67a-01c8-421f-bd65-c90438d4f768 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:09.793365 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-fdd0b67a-01c8-421f-bd65-c90438d4f768 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:09.794030 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-fdd0b67a-01c8-421f-bd65-c90438d4f768 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:09.795265 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-fdd0b67a-01c8-421f-bd65-c90438d4f768 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:09.796818 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-fdd0b67a-01c8-421f-bd65-c90438d4f768 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:09.797078 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-fdd0b67a-01c8-421f-bd65-c90438d4f768 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:09.803867 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.compute.server_external_events [req-510493f0-2d95-44f7-8e15-3d429e549753 req-650194a3-d4f7-4fdc-ab8c-ab3dd5865456 service nova] Creating event network-vif-plugged:8bab0b25-2131-47ef-88e3-210f0d9e7556 for instance e20f4f93-c27e-4971-a495-a3498f2611eb on hv-cinder-83124 Sep 09 16:39:09.815176 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [req-510493f0-2d95-44f7-8e15-3d429e549753 req-650194a3-d4f7-4fdc-ab8c-ab3dd5865456 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071779 Sep 09 16:39:09.817477 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 456/899] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Sep 9 16:39:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 16:39:10.248041 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-fdd0b67a-01c8-421f-bd65-c90438d4f768 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:39:10.273596 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-fdd0b67a-01c8-421f-bd65-c90438d4f768 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:39:10.283282 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-fdd0b67a-01c8-421f-bd65-c90438d4f768 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:39:10.284602 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-fdd0b67a-01c8-421f-bd65-c90438d4f768 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb" status: 200 len: 1728 microversion: 2.20 time: 0.508524 Sep 09 16:39:10.289265 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 444/900] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Sep 9 16:39:09 2022] GET /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb => generated 1728 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 16:39:10.442574 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-fd7dcc87-3704-4ee3-b0d3-7ba2cbf0dba8 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:39:10.443470 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-fd7dcc87-3704-4ee3-b0d3-7ba2cbf0dba8 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] [instance: 9bed6256-fc6f-40dd-b465-54981581a6aa] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:39:10.456215 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fd7dcc87-3704-4ee3-b0d3-7ba2cbf0dba8 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:10.457093 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fd7dcc87-3704-4ee3-b0d3-7ba2cbf0dba8 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:10.457533 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fd7dcc87-3704-4ee3-b0d3-7ba2cbf0dba8 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:10.458822 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fd7dcc87-3704-4ee3-b0d3-7ba2cbf0dba8 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:10.459449 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fd7dcc87-3704-4ee3-b0d3-7ba2cbf0dba8 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:10.460435 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fd7dcc87-3704-4ee3-b0d3-7ba2cbf0dba8 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:10.704656 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-fd7dcc87-3704-4ee3-b0d3-7ba2cbf0dba8 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208daa6413d34e4496e278fb3fc251a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba803ac5e71467f853215e19a7f8867', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:39:10.716844 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-fd7dcc87-3704-4ee3-b0d3-7ba2cbf0dba8 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] 10.222.0.23 "GET /compute/v2.1/servers/9bed6256-fc6f-40dd-b465-54981581a6aa" status: 200 len: 1562 microversion: 2.1 time: 0.278992 Sep 09 16:39:10.719146 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 457/901] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:39:10 2022] GET /compute/v2.1/servers/9bed6256-fc6f-40dd-b465-54981581a6aa => generated 1562 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:39:11.315663 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-c71a555d-92bc-4d02-85eb-6f3ea2bf4d5a tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:39:11.316578 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-c71a555d-92bc-4d02-85eb-6f3ea2bf4d5a tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: e20f4f93-c27e-4971-a495-a3498f2611eb] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:39:11.323546 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-c71a555d-92bc-4d02-85eb-6f3ea2bf4d5a tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:11.324285 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-c71a555d-92bc-4d02-85eb-6f3ea2bf4d5a tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:11.324879 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-c71a555d-92bc-4d02-85eb-6f3ea2bf4d5a tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:11.325768 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-c71a555d-92bc-4d02-85eb-6f3ea2bf4d5a tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:11.326398 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-c71a555d-92bc-4d02-85eb-6f3ea2bf4d5a tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:11.327197 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-c71a555d-92bc-4d02-85eb-6f3ea2bf4d5a tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:11.501971 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-c71a555d-92bc-4d02-85eb-6f3ea2bf4d5a tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:39:11.514138 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-c71a555d-92bc-4d02-85eb-6f3ea2bf4d5a tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:39:11.516480 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-c71a555d-92bc-4d02-85eb-6f3ea2bf4d5a tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:39:11.529418 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-c71a555d-92bc-4d02-85eb-6f3ea2bf4d5a tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb" status: 200 len: 1728 microversion: 2.20 time: 0.219748 Sep 09 16:39:11.530565 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 445/902] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Sep 9 16:39:11 2022] GET /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb => generated 1728 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 16:39:12.556722 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-193691c9-7837-47ed-bf7b-cb83e99f1a01 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:39:12.557338 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-193691c9-7837-47ed-bf7b-cb83e99f1a01 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: e20f4f93-c27e-4971-a495-a3498f2611eb] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:39:12.564537 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-193691c9-7837-47ed-bf7b-cb83e99f1a01 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:12.565017 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-193691c9-7837-47ed-bf7b-cb83e99f1a01 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:12.565445 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-193691c9-7837-47ed-bf7b-cb83e99f1a01 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:12.566118 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-193691c9-7837-47ed-bf7b-cb83e99f1a01 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:12.566587 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-193691c9-7837-47ed-bf7b-cb83e99f1a01 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:12.567006 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-193691c9-7837-47ed-bf7b-cb83e99f1a01 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:12.715596 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-193691c9-7837-47ed-bf7b-cb83e99f1a01 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:39:12.725779 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-193691c9-7837-47ed-bf7b-cb83e99f1a01 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:39:12.727542 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-193691c9-7837-47ed-bf7b-cb83e99f1a01 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:39:12.728996 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-193691c9-7837-47ed-bf7b-cb83e99f1a01 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb" status: 200 len: 1728 microversion: 2.20 time: 0.176720 Sep 09 16:39:12.743421 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 458/903] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Sep 9 16:39:12 2022] GET /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb => generated 1728 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 16:39:13.755578 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-58ddfea6-8474-4c9b-94ae-67c0a57e01af tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:39:13.757068 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-58ddfea6-8474-4c9b-94ae-67c0a57e01af tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: e20f4f93-c27e-4971-a495-a3498f2611eb] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:39:13.764066 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-58ddfea6-8474-4c9b-94ae-67c0a57e01af tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:13.764539 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-58ddfea6-8474-4c9b-94ae-67c0a57e01af tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:13.765202 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-58ddfea6-8474-4c9b-94ae-67c0a57e01af tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:13.766043 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-58ddfea6-8474-4c9b-94ae-67c0a57e01af tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:13.766974 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-58ddfea6-8474-4c9b-94ae-67c0a57e01af tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:13.767621 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-58ddfea6-8474-4c9b-94ae-67c0a57e01af tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:13.920847 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-58ddfea6-8474-4c9b-94ae-67c0a57e01af tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:39:13.930962 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-58ddfea6-8474-4c9b-94ae-67c0a57e01af tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:39:13.934476 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-58ddfea6-8474-4c9b-94ae-67c0a57e01af tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:39:13.942017 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-58ddfea6-8474-4c9b-94ae-67c0a57e01af tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb" status: 200 len: 1728 microversion: 2.20 time: 0.190231 Sep 09 16:39:13.943943 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 446/904] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Sep 9 16:39:13 2022] GET /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb => generated 1728 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 16:39:14.973152 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-a43d8337-1e21-44bc-897e-a63b7b5d09e5 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:39:14.973780 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-a43d8337-1e21-44bc-897e-a63b7b5d09e5 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: e20f4f93-c27e-4971-a495-a3498f2611eb] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:39:14.986454 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a43d8337-1e21-44bc-897e-a63b7b5d09e5 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:14.986454 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a43d8337-1e21-44bc-897e-a63b7b5d09e5 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:14.986454 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a43d8337-1e21-44bc-897e-a63b7b5d09e5 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:14.986454 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a43d8337-1e21-44bc-897e-a63b7b5d09e5 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:14.987032 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a43d8337-1e21-44bc-897e-a63b7b5d09e5 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:14.987032 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a43d8337-1e21-44bc-897e-a63b7b5d09e5 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:15.153065 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-a43d8337-1e21-44bc-897e-a63b7b5d09e5 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:39:15.168222 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-a43d8337-1e21-44bc-897e-a63b7b5d09e5 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:39:15.179583 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-a43d8337-1e21-44bc-897e-a63b7b5d09e5 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:39:15.182626 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-a43d8337-1e21-44bc-897e-a63b7b5d09e5 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb" status: 200 len: 1728 microversion: 2.20 time: 0.211809 Sep 09 16:39:15.182626 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 459/905] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Sep 9 16:39:14 2022] GET /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb => generated 1728 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 16:39:15.826493 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-14589f02-f09f-42c0-95be-e5f1eeaea115 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Action: 'create', calling method: .version_select at 0x7f24fb5090d0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-172403749", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPVBVGPHVWeXC4Myi88RN5nnzc7o0YmoMd9OvQBhOsrz+M6+gYG45LER3mvVxmn0B7Lj4MNdljCYO+psqrsy5fWs9IbLsqaexVZDL8JmGS33wkK6gHqQYZP4H1SjLGp39Q=="}} {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:39:15.843406 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.quota [None req-14589f02-f09f-42c0-95be-e5f1eeaea115 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Getting quotas for project ff5daf9e9245447dac44278ce813b4a0. Resources: {'key_pairs'} {{(pid=127196) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 16:39:15.847317 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.quota [None req-14589f02-f09f-42c0-95be-e5f1eeaea115 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Getting quotas for user f86d1ec821814f628879590513702cec and project ff5daf9e9245447dac44278ce813b4a0. Resources: {'key_pairs'} {{(pid=127196) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 16:39:15.871675 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-14589f02-f09f-42c0-95be-e5f1eeaea115 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.049097 Sep 09 16:39:15.872256 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 447/906] 10.222.0.23 () {60 vars in 1159 bytes} [Fri Sep 9 16:39:15 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:39:15.929424 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-76b0653f-866b-4132-8105-a4b3a0380630 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1782280862", "imageRef": "eff6bb4e-e84e-4494-b243-cf966e430c11", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-172403749", "networks": [{"uuid": "feb7a932-ad8b-409c-bde1-8a6fb86d0c28"}]}} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:39:15.983397 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.network.neutron [None req-76b0653f-866b-4132-8105-a4b3a0380630 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] validate_networks() for [('feb7a932-ad8b-409c-bde1-8a6fb86d0c28', None, None, None, None, None)] {{(pid=127198) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 16:39:16.212381 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-d4d63493-cf7a-45ce-a067-7b1a7a81c68a tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:39:16.212993 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-d4d63493-cf7a-45ce-a067-7b1a7a81c68a tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: e20f4f93-c27e-4971-a495-a3498f2611eb] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:39:16.219724 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-d4d63493-cf7a-45ce-a067-7b1a7a81c68a tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:16.220141 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-d4d63493-cf7a-45ce-a067-7b1a7a81c68a tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:16.220599 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-d4d63493-cf7a-45ce-a067-7b1a7a81c68a tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:16.221310 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-d4d63493-cf7a-45ce-a067-7b1a7a81c68a tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:16.221728 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-d4d63493-cf7a-45ce-a067-7b1a7a81c68a tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:16.222143 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-d4d63493-cf7a-45ce-a067-7b1a7a81c68a tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:16.413008 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-d4d63493-cf7a-45ce-a067-7b1a7a81c68a tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:39:16.421544 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-d4d63493-cf7a-45ce-a067-7b1a7a81c68a tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:39:16.423059 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-d4d63493-cf7a-45ce-a067-7b1a7a81c68a tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:39:16.424256 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-d4d63493-cf7a-45ce-a067-7b1a7a81c68a tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb" status: 200 len: 1728 microversion: 2.20 time: 0.216106 Sep 09 16:39:16.424779 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 448/907] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Sep 9 16:39:16 2022] GET /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb => generated 1728 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 16:39:16.522865 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-76b0653f-866b-4132-8105-a4b3a0380630 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Flavor limits 0:0:0 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 16:39:16.523286 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-76b0653f-866b-4132-8105-a4b3a0380630 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Image limits 0:0:0 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 16:39:16.523767 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-76b0653f-866b-4132-8105-a4b3a0380630 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Flavor pref 0:0:0 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 16:39:16.524176 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-76b0653f-866b-4132-8105-a4b3a0380630 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Image pref 0:0:0 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 16:39:16.524583 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-76b0653f-866b-4132-8105-a4b3a0380630 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 16:39:16.534011 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-76b0653f-866b-4132-8105-a4b3a0380630 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:16.534482 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-76b0653f-866b-4132-8105-a4b3a0380630 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:16.534967 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-76b0653f-866b-4132-8105-a4b3a0380630 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:16.535668 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-76b0653f-866b-4132-8105-a4b3a0380630 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:16.536113 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-76b0653f-866b-4132-8105-a4b3a0380630 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:16.536531 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-76b0653f-866b-4132-8105-a4b3a0380630 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:16.555196 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.quota [None req-76b0653f-866b-4132-8105-a4b3a0380630 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Getting quotas for project ff5daf9e9245447dac44278ce813b4a0. Resources: {'cores', 'instances', 'ram'} {{(pid=127198) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 16:39:16.559648 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.quota [None req-76b0653f-866b-4132-8105-a4b3a0380630 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Getting quotas for user f86d1ec821814f628879590513702cec and project ff5daf9e9245447dac44278ce813b4a0. Resources: {'cores', 'instances', 'ram'} {{(pid=127198) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 16:39:16.570950 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-76b0653f-866b-4132-8105-a4b3a0380630 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Going to run 1 instances... {{(pid=127198) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 16:39:16.573227 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-76b0653f-866b-4132-8105-a4b3a0380630 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] [instance: 667d78d5-e585-4ce5-a240-797cf2202816] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='eff6bb4e-e84e-4494-b243-cf966e430c11',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127198) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 16:39:16.620143 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-76b0653f-866b-4132-8105-a4b3a0380630 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.694777 Sep 09 16:39:16.620778 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 460/908] 10.222.0.23 () {60 vars in 1147 bytes} [Fri Sep 9 16:39:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 696 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 16:39:16.632403 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-592300ff-3215-4214-981f-8629a61838e4 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:39:16.633147 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-592300ff-3215-4214-981f-8629a61838e4 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] [instance: 667d78d5-e585-4ce5-a240-797cf2202816] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:39:16.688370 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-592300ff-3215-4214-981f-8629a61838e4 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86d1ec821814f628879590513702cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5daf9e9245447dac44278ce813b4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:39:16.695226 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-592300ff-3215-4214-981f-8629a61838e4 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] 10.222.0.23 "GET /compute/v2.1/servers/667d78d5-e585-4ce5-a240-797cf2202816" status: 200 len: 1258 microversion: 2.1 time: 0.066837 Sep 09 16:39:16.695793 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 449/909] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:39:16 2022] GET /compute/v2.1/servers/667d78d5-e585-4ce5-a240-797cf2202816 => generated 1258 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:39:17.454343 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-7b0f07b9-5511-43cf-903c-5c143536208a tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:39:17.455367 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-7b0f07b9-5511-43cf-903c-5c143536208a tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: e20f4f93-c27e-4971-a495-a3498f2611eb] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:39:17.464732 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7b0f07b9-5511-43cf-903c-5c143536208a tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:17.465208 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7b0f07b9-5511-43cf-903c-5c143536208a tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:17.465667 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7b0f07b9-5511-43cf-903c-5c143536208a tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:17.466332 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7b0f07b9-5511-43cf-903c-5c143536208a tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:17.466838 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7b0f07b9-5511-43cf-903c-5c143536208a tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:17.467254 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7b0f07b9-5511-43cf-903c-5c143536208a tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:17.607316 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-7b0f07b9-5511-43cf-903c-5c143536208a tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:39:17.620646 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-7b0f07b9-5511-43cf-903c-5c143536208a tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:39:17.622882 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-7b0f07b9-5511-43cf-903c-5c143536208a tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:39:17.624628 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-7b0f07b9-5511-43cf-903c-5c143536208a tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb" status: 200 len: 1728 microversion: 2.20 time: 0.177530 Sep 09 16:39:17.625360 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 461/910] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Sep 9 16:39:17 2022] GET /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb => generated 1728 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 16:39:17.720090 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-54b696f1-4a34-4881-a505-a654a7d1ce03 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:39:17.720767 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-54b696f1-4a34-4881-a505-a654a7d1ce03 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] [instance: 667d78d5-e585-4ce5-a240-797cf2202816] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:39:17.729300 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-54b696f1-4a34-4881-a505-a654a7d1ce03 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:17.729779 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-54b696f1-4a34-4881-a505-a654a7d1ce03 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:17.730208 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-54b696f1-4a34-4881-a505-a654a7d1ce03 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:17.730933 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-54b696f1-4a34-4881-a505-a654a7d1ce03 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:17.731385 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-54b696f1-4a34-4881-a505-a654a7d1ce03 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:17.731800 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-54b696f1-4a34-4881-a505-a654a7d1ce03 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:17.796478 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-54b696f1-4a34-4881-a505-a654a7d1ce03 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86d1ec821814f628879590513702cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5daf9e9245447dac44278ce813b4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:39:17.804655 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-54b696f1-4a34-4881-a505-a654a7d1ce03 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] 10.222.0.23 "GET /compute/v2.1/servers/667d78d5-e585-4ce5-a240-797cf2202816" status: 200 len: 1262 microversion: 2.1 time: 0.090384 Sep 09 16:39:17.805216 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 450/911] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:39:17 2022] GET /compute/v2.1/servers/667d78d5-e585-4ce5-a240-797cf2202816 => generated 1262 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:39:18.656928 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-d8d1ff53-b74b-4f09-ab0f-f32f76aa5b8e tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:39:18.657524 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-d8d1ff53-b74b-4f09-ab0f-f32f76aa5b8e tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: e20f4f93-c27e-4971-a495-a3498f2611eb] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:39:18.667540 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d8d1ff53-b74b-4f09-ab0f-f32f76aa5b8e tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:18.667970 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d8d1ff53-b74b-4f09-ab0f-f32f76aa5b8e tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:18.668555 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d8d1ff53-b74b-4f09-ab0f-f32f76aa5b8e tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:18.669458 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d8d1ff53-b74b-4f09-ab0f-f32f76aa5b8e tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:18.670094 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d8d1ff53-b74b-4f09-ab0f-f32f76aa5b8e tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:18.670690 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d8d1ff53-b74b-4f09-ab0f-f32f76aa5b8e tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:18.803809 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-d8d1ff53-b74b-4f09-ab0f-f32f76aa5b8e tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:39:18.813401 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-d8d1ff53-b74b-4f09-ab0f-f32f76aa5b8e tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:39:18.814882 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-d8d1ff53-b74b-4f09-ab0f-f32f76aa5b8e tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:39:18.816054 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-d8d1ff53-b74b-4f09-ab0f-f32f76aa5b8e tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb" status: 200 len: 1715 microversion: 2.20 time: 0.165529 Sep 09 16:39:18.816615 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 462/912] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Sep 9 16:39:18 2022] GET /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb => generated 1715 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 16:39:18.829642 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-13a547a3-5d44-4550-8db8-18a5d2ec75a7 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:39:18.830350 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-13a547a3-5d44-4550-8db8-18a5d2ec75a7 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] [instance: 667d78d5-e585-4ce5-a240-797cf2202816] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:39:18.839614 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-13a547a3-5d44-4550-8db8-18a5d2ec75a7 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:18.840192 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-13a547a3-5d44-4550-8db8-18a5d2ec75a7 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:18.840777 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-13a547a3-5d44-4550-8db8-18a5d2ec75a7 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:18.841479 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-13a547a3-5d44-4550-8db8-18a5d2ec75a7 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:18.841929 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-13a547a3-5d44-4550-8db8-18a5d2ec75a7 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:18.842389 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-13a547a3-5d44-4550-8db8-18a5d2ec75a7 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:18.906779 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-13a547a3-5d44-4550-8db8-18a5d2ec75a7 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86d1ec821814f628879590513702cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5daf9e9245447dac44278ce813b4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:39:18.914936 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-13a547a3-5d44-4550-8db8-18a5d2ec75a7 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] 10.222.0.23 "GET /compute/v2.1/servers/667d78d5-e585-4ce5-a240-797cf2202816" status: 200 len: 1262 microversion: 2.1 time: 0.091378 Sep 09 16:39:18.915532 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 451/913] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:39:18 2022] GET /compute/v2.1/servers/667d78d5-e585-4ce5-a240-797cf2202816 => generated 1262 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:39:19.937445 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-e79ba617-e819-4d62-8b39-0f8014d50910 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:39:19.938280 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-e79ba617-e819-4d62-8b39-0f8014d50910 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] [instance: 667d78d5-e585-4ce5-a240-797cf2202816] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:39:19.946174 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e79ba617-e819-4d62-8b39-0f8014d50910 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:19.946757 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e79ba617-e819-4d62-8b39-0f8014d50910 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:19.947251 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e79ba617-e819-4d62-8b39-0f8014d50910 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:19.948102 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e79ba617-e819-4d62-8b39-0f8014d50910 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:19.948631 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e79ba617-e819-4d62-8b39-0f8014d50910 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:19.949113 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e79ba617-e819-4d62-8b39-0f8014d50910 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:20.024434 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-e79ba617-e819-4d62-8b39-0f8014d50910 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86d1ec821814f628879590513702cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5daf9e9245447dac44278ce813b4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:39:20.026854 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell1:SELECT=100 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:39:20.034545 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-e79ba617-e819-4d62-8b39-0f8014d50910 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] 10.222.0.23 "GET /compute/v2.1/servers/667d78d5-e585-4ce5-a240-797cf2202816" status: 200 len: 1316 microversion: 2.1 time: 0.101016 Sep 09 16:39:20.035707 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 463/914] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:39:19 2022] GET /compute/v2.1/servers/667d78d5-e585-4ce5-a240-797cf2202816 => generated 1316 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:39:21.060047 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-3808d0e9-e041-4362-aae1-d51c5c9b8392 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:39:21.060595 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-3808d0e9-e041-4362-aae1-d51c5c9b8392 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] [instance: 667d78d5-e585-4ce5-a240-797cf2202816] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:39:21.067737 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-3808d0e9-e041-4362-aae1-d51c5c9b8392 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:21.068223 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-3808d0e9-e041-4362-aae1-d51c5c9b8392 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:21.068659 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-3808d0e9-e041-4362-aae1-d51c5c9b8392 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:21.069355 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-3808d0e9-e041-4362-aae1-d51c5c9b8392 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:21.069815 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-3808d0e9-e041-4362-aae1-d51c5c9b8392 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:21.070271 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-3808d0e9-e041-4362-aae1-d51c5c9b8392 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:21.205832 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-3808d0e9-e041-4362-aae1-d51c5c9b8392 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86d1ec821814f628879590513702cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5daf9e9245447dac44278ce813b4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:39:21.213852 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-3808d0e9-e041-4362-aae1-d51c5c9b8392 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] 10.222.0.23 "GET /compute/v2.1/servers/667d78d5-e585-4ce5-a240-797cf2202816" status: 200 len: 1358 microversion: 2.1 time: 0.159053 Sep 09 16:39:21.214419 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 452/915] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:39:21 2022] GET /compute/v2.1/servers/667d78d5-e585-4ce5-a240-797cf2202816 => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:39:22.241181 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-663e5fce-cf81-452f-97f9-5db58273f629 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:39:22.242187 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-663e5fce-cf81-452f-97f9-5db58273f629 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] [instance: 667d78d5-e585-4ce5-a240-797cf2202816] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:39:22.246309 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:39:22.255472 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-663e5fce-cf81-452f-97f9-5db58273f629 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:22.256260 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-663e5fce-cf81-452f-97f9-5db58273f629 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:22.256974 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-663e5fce-cf81-452f-97f9-5db58273f629 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:22.258104 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-663e5fce-cf81-452f-97f9-5db58273f629 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:22.258902 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-663e5fce-cf81-452f-97f9-5db58273f629 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:22.259606 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-663e5fce-cf81-452f-97f9-5db58273f629 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:22.391635 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-663e5fce-cf81-452f-97f9-5db58273f629 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86d1ec821814f628879590513702cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5daf9e9245447dac44278ce813b4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:39:22.399607 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-663e5fce-cf81-452f-97f9-5db58273f629 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] 10.222.0.23 "GET /compute/v2.1/servers/667d78d5-e585-4ce5-a240-797cf2202816" status: 200 len: 1358 microversion: 2.1 time: 0.165113 Sep 09 16:39:22.400208 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 464/916] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:39:22 2022] GET /compute/v2.1/servers/667d78d5-e585-4ce5-a240-797cf2202816 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:39:23.423114 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-39f4b4e8-1593-4e26-b82a-5299812dc4c9 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:39:23.423859 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-39f4b4e8-1593-4e26-b82a-5299812dc4c9 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] [instance: 667d78d5-e585-4ce5-a240-797cf2202816] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:39:23.430366 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-39f4b4e8-1593-4e26-b82a-5299812dc4c9 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:23.430882 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-39f4b4e8-1593-4e26-b82a-5299812dc4c9 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:23.431315 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-39f4b4e8-1593-4e26-b82a-5299812dc4c9 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:23.432222 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-39f4b4e8-1593-4e26-b82a-5299812dc4c9 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:23.432670 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-39f4b4e8-1593-4e26-b82a-5299812dc4c9 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:23.433084 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-39f4b4e8-1593-4e26-b82a-5299812dc4c9 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:23.436039 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG dbcounter [-] [127196] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:39:23.588067 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-39f4b4e8-1593-4e26-b82a-5299812dc4c9 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86d1ec821814f628879590513702cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5daf9e9245447dac44278ce813b4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:39:23.598590 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-39f4b4e8-1593-4e26-b82a-5299812dc4c9 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] 10.222.0.23 "GET /compute/v2.1/servers/667d78d5-e585-4ce5-a240-797cf2202816" status: 200 len: 1358 microversion: 2.1 time: 0.179136 Sep 09 16:39:23.599721 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 453/917] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:39:23 2022] GET /compute/v2.1/servers/667d78d5-e585-4ce5-a240-797cf2202816 => generated 1358 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:39:24.627116 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-9cb99fbf-6f78-4f40-9008-cca9ea3395f0 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:39:24.627679 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-9cb99fbf-6f78-4f40-9008-cca9ea3395f0 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] [instance: 667d78d5-e585-4ce5-a240-797cf2202816] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:39:24.634383 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9cb99fbf-6f78-4f40-9008-cca9ea3395f0 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:24.635065 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9cb99fbf-6f78-4f40-9008-cca9ea3395f0 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:24.635664 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9cb99fbf-6f78-4f40-9008-cca9ea3395f0 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:24.636437 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9cb99fbf-6f78-4f40-9008-cca9ea3395f0 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:24.636897 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9cb99fbf-6f78-4f40-9008-cca9ea3395f0 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:24.637401 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9cb99fbf-6f78-4f40-9008-cca9ea3395f0 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:24.791114 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-9cb99fbf-6f78-4f40-9008-cca9ea3395f0 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86d1ec821814f628879590513702cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5daf9e9245447dac44278ce813b4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:39:24.800296 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-9cb99fbf-6f78-4f40-9008-cca9ea3395f0 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] 10.222.0.23 "GET /compute/v2.1/servers/667d78d5-e585-4ce5-a240-797cf2202816" status: 200 len: 1358 microversion: 2.1 time: 0.177319 Sep 09 16:39:24.800867 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 465/918] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:39:24 2022] GET /compute/v2.1/servers/667d78d5-e585-4ce5-a240-797cf2202816 => generated 1358 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:39:25.823888 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-c96a711b-0123-4623-97f2-fd39e40bc8ac tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:39:25.824506 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-c96a711b-0123-4623-97f2-fd39e40bc8ac tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] [instance: 667d78d5-e585-4ce5-a240-797cf2202816] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:39:25.831384 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-c96a711b-0123-4623-97f2-fd39e40bc8ac tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:25.831852 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-c96a711b-0123-4623-97f2-fd39e40bc8ac tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:25.832271 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-c96a711b-0123-4623-97f2-fd39e40bc8ac tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:25.832962 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-c96a711b-0123-4623-97f2-fd39e40bc8ac tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:25.833409 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-c96a711b-0123-4623-97f2-fd39e40bc8ac tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:25.833834 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-c96a711b-0123-4623-97f2-fd39e40bc8ac tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:25.971049 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-c96a711b-0123-4623-97f2-fd39e40bc8ac tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86d1ec821814f628879590513702cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5daf9e9245447dac44278ce813b4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:39:25.979137 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-c96a711b-0123-4623-97f2-fd39e40bc8ac tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] 10.222.0.23 "GET /compute/v2.1/servers/667d78d5-e585-4ce5-a240-797cf2202816" status: 200 len: 1358 microversion: 2.1 time: 0.159309 Sep 09 16:39:25.979721 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 454/919] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:39:25 2022] GET /compute/v2.1/servers/667d78d5-e585-4ce5-a240-797cf2202816 => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:39:27.001462 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-4de461b2-a9d3-4cfc-a258-8b216b0561bb tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:39:27.003024 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-4de461b2-a9d3-4cfc-a258-8b216b0561bb tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] [instance: 667d78d5-e585-4ce5-a240-797cf2202816] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:39:27.005915 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell0:SELECT=2 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:39:27.006603 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell0:SELECT=6 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:39:27.020705 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4de461b2-a9d3-4cfc-a258-8b216b0561bb tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:27.021207 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4de461b2-a9d3-4cfc-a258-8b216b0561bb tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:27.021641 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4de461b2-a9d3-4cfc-a258-8b216b0561bb tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:27.022595 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4de461b2-a9d3-4cfc-a258-8b216b0561bb tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:27.023057 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4de461b2-a9d3-4cfc-a258-8b216b0561bb tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:27.023474 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4de461b2-a9d3-4cfc-a258-8b216b0561bb tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:27.233407 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-4de461b2-a9d3-4cfc-a258-8b216b0561bb tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86d1ec821814f628879590513702cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5daf9e9245447dac44278ce813b4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:39:27.242056 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-4de461b2-a9d3-4cfc-a258-8b216b0561bb tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] 10.222.0.23 "GET /compute/v2.1/servers/667d78d5-e585-4ce5-a240-797cf2202816" status: 200 len: 1358 microversion: 2.1 time: 0.244439 Sep 09 16:39:27.250984 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 466/920] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:39:26 2022] GET /compute/v2.1/servers/667d78d5-e585-4ce5-a240-797cf2202816 => generated 1358 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:39:27.267392 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-c27dc979-5764-4a37-8d14-cec850e5c2fb tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:39:27.268014 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-c27dc979-5764-4a37-8d14-cec850e5c2fb tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] [instance: ce8ce7fc-5de7-4d65-b26b-e1a60b59f8a1] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:39:27.269796 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG dbcounter [-] [127196] Writing DB stats nova_cell0:SELECT=6 {{(pid=127196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:39:27.275558 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-c27dc979-5764-4a37-8d14-cec850e5c2fb tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:27.276051 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-c27dc979-5764-4a37-8d14-cec850e5c2fb tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:27.276481 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-c27dc979-5764-4a37-8d14-cec850e5c2fb tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:27.277184 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-c27dc979-5764-4a37-8d14-cec850e5c2fb tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:27.277649 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-c27dc979-5764-4a37-8d14-cec850e5c2fb tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:27.278094 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-c27dc979-5764-4a37-8d14-cec850e5c2fb tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:27.389719 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.objects.instance [None req-c27dc979-5764-4a37-8d14-cec850e5c2fb tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Lazy-loading 'services' on Instance uuid ce8ce7fc-5de7-4d65-b26b-e1a60b59f8a1 {{(pid=127196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 16:39:27.501335 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-c27dc979-5764-4a37-8d14-cec850e5c2fb tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ce8ce7fc-5de7-4d65-b26b-e1a60b59f8a1/os-volume_attachments/0553db58-3699-4b99-8d81-04d4634d3805" status: 202 len: 0 microversion: 2.1 time: 0.237808 Sep 09 16:39:27.502296 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 455/921] 10.222.0.23 () {58 vars in 1416 bytes} [Fri Sep 9 16:39:27 2022] DELETE /compute/v2.1/servers/ce8ce7fc-5de7-4d65-b26b-e1a60b59f8a1/os-volume_attachments/0553db58-3699-4b99-8d81-04d4634d3805 => generated 0 bytes in 245 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 09 16:39:28.266723 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-6dfbd53a-8919-4a29-b6cb-4af373486822 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:39:28.267905 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-6dfbd53a-8919-4a29-b6cb-4af373486822 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] [instance: 667d78d5-e585-4ce5-a240-797cf2202816] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:39:28.276692 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6dfbd53a-8919-4a29-b6cb-4af373486822 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:28.277438 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6dfbd53a-8919-4a29-b6cb-4af373486822 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:28.278066 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6dfbd53a-8919-4a29-b6cb-4af373486822 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:28.278967 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6dfbd53a-8919-4a29-b6cb-4af373486822 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:28.279574 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6dfbd53a-8919-4a29-b6cb-4af373486822 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:28.280816 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6dfbd53a-8919-4a29-b6cb-4af373486822 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:28.442388 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-6dfbd53a-8919-4a29-b6cb-4af373486822 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86d1ec821814f628879590513702cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5daf9e9245447dac44278ce813b4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:39:28.450795 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-6dfbd53a-8919-4a29-b6cb-4af373486822 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] 10.222.0.23 "GET /compute/v2.1/servers/667d78d5-e585-4ce5-a240-797cf2202816" status: 200 len: 1358 microversion: 2.1 time: 0.189333 Sep 09 16:39:28.451361 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 467/922] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:39:28 2022] GET /compute/v2.1/servers/667d78d5-e585-4ce5-a240-797cf2202816 => generated 1358 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:39:29.474424 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-c8fbe22c-1c2d-49ce-a9b5-dfb1679beffd tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:39:29.475047 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-c8fbe22c-1c2d-49ce-a9b5-dfb1679beffd tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] [instance: 667d78d5-e585-4ce5-a240-797cf2202816] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:39:29.481956 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-c8fbe22c-1c2d-49ce-a9b5-dfb1679beffd tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:29.482437 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-c8fbe22c-1c2d-49ce-a9b5-dfb1679beffd tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:29.482898 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-c8fbe22c-1c2d-49ce-a9b5-dfb1679beffd tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:29.483594 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-c8fbe22c-1c2d-49ce-a9b5-dfb1679beffd tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:29.484079 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-c8fbe22c-1c2d-49ce-a9b5-dfb1679beffd tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:29.484608 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-c8fbe22c-1c2d-49ce-a9b5-dfb1679beffd tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:29.640752 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-c8fbe22c-1c2d-49ce-a9b5-dfb1679beffd tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86d1ec821814f628879590513702cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5daf9e9245447dac44278ce813b4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:39:29.648804 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-c8fbe22c-1c2d-49ce-a9b5-dfb1679beffd tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] 10.222.0.23 "GET /compute/v2.1/servers/667d78d5-e585-4ce5-a240-797cf2202816" status: 200 len: 1358 microversion: 2.1 time: 0.178900 Sep 09 16:39:29.649641 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 456/923] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:39:29 2022] GET /compute/v2.1/servers/667d78d5-e585-4ce5-a240-797cf2202816 => generated 1358 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:39:30.675880 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-7102eed5-2f5b-4672-beb8-3ec4888a72e5 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:39:30.676485 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-7102eed5-2f5b-4672-beb8-3ec4888a72e5 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] [instance: 667d78d5-e585-4ce5-a240-797cf2202816] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:39:30.683277 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7102eed5-2f5b-4672-beb8-3ec4888a72e5 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:30.684090 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7102eed5-2f5b-4672-beb8-3ec4888a72e5 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:30.685201 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7102eed5-2f5b-4672-beb8-3ec4888a72e5 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:30.686059 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7102eed5-2f5b-4672-beb8-3ec4888a72e5 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:30.686801 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7102eed5-2f5b-4672-beb8-3ec4888a72e5 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:30.687445 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7102eed5-2f5b-4672-beb8-3ec4888a72e5 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:30.875175 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-7102eed5-2f5b-4672-beb8-3ec4888a72e5 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86d1ec821814f628879590513702cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5daf9e9245447dac44278ce813b4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:39:30.885832 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-7102eed5-2f5b-4672-beb8-3ec4888a72e5 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] 10.222.0.23 "GET /compute/v2.1/servers/667d78d5-e585-4ce5-a240-797cf2202816" status: 200 len: 1358 microversion: 2.1 time: 0.213686 Sep 09 16:39:30.887096 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 468/924] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:39:30 2022] GET /compute/v2.1/servers/667d78d5-e585-4ce5-a240-797cf2202816 => generated 1358 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:39:31.913202 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-ada38c24-b4d4-4e31-8ce6-f275a0fb1dd8 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:39:31.913955 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-ada38c24-b4d4-4e31-8ce6-f275a0fb1dd8 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] [instance: 667d78d5-e585-4ce5-a240-797cf2202816] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:39:31.922523 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-ada38c24-b4d4-4e31-8ce6-f275a0fb1dd8 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:31.923014 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-ada38c24-b4d4-4e31-8ce6-f275a0fb1dd8 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:31.923448 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-ada38c24-b4d4-4e31-8ce6-f275a0fb1dd8 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:31.924141 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-ada38c24-b4d4-4e31-8ce6-f275a0fb1dd8 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:31.924591 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-ada38c24-b4d4-4e31-8ce6-f275a0fb1dd8 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:31.925009 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-ada38c24-b4d4-4e31-8ce6-f275a0fb1dd8 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:32.054860 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-ada38c24-b4d4-4e31-8ce6-f275a0fb1dd8 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86d1ec821814f628879590513702cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5daf9e9245447dac44278ce813b4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:39:32.064794 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-ada38c24-b4d4-4e31-8ce6-f275a0fb1dd8 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] 10.222.0.23 "GET /compute/v2.1/servers/667d78d5-e585-4ce5-a240-797cf2202816" status: 200 len: 1358 microversion: 2.1 time: 0.157249 Sep 09 16:39:32.065359 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 457/925] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:39:31 2022] GET /compute/v2.1/servers/667d78d5-e585-4ce5-a240-797cf2202816 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:39:32.950165 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [req-5b4db623-a57e-48a1-9797-18bcbbf2fad8 req-9d7fc6da-99b0-4bd1-a299-1ee0f95c5a82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "667d78d5-e585-4ce5-a240-797cf2202816", "tag": "5d5ee3f8-848f-4ebf-b6d0-9b071a89552e"}]} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:39:32.960796 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-5b4db623-a57e-48a1-9797-18bcbbf2fad8 req-9d7fc6da-99b0-4bd1-a299-1ee0f95c5a82 service nova] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:32.961366 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-5b4db623-a57e-48a1-9797-18bcbbf2fad8 req-9d7fc6da-99b0-4bd1-a299-1ee0f95c5a82 service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:32.961945 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-5b4db623-a57e-48a1-9797-18bcbbf2fad8 req-9d7fc6da-99b0-4bd1-a299-1ee0f95c5a82 service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:32.973616 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.compute.server_external_events [req-5b4db623-a57e-48a1-9797-18bcbbf2fad8 req-9d7fc6da-99b0-4bd1-a299-1ee0f95c5a82 service nova] Creating event network-changed:5d5ee3f8-848f-4ebf-b6d0-9b071a89552e for instance 667d78d5-e585-4ce5-a240-797cf2202816 on hv-cinder-83124 Sep 09 16:39:32.979137 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [req-5b4db623-a57e-48a1-9797-18bcbbf2fad8 req-9d7fc6da-99b0-4bd1-a299-1ee0f95c5a82 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032729 Sep 09 16:39:32.979850 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 469/926] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Sep 9 16:39:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:39:33.090135 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-6b749ce0-f2e3-42f2-b3a0-3d0538066fc4 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:39:33.091281 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-6b749ce0-f2e3-42f2-b3a0-3d0538066fc4 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] [instance: 667d78d5-e585-4ce5-a240-797cf2202816] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:39:33.097985 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-6b749ce0-f2e3-42f2-b3a0-3d0538066fc4 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:33.098460 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-6b749ce0-f2e3-42f2-b3a0-3d0538066fc4 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:33.099159 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-6b749ce0-f2e3-42f2-b3a0-3d0538066fc4 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:33.099866 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-6b749ce0-f2e3-42f2-b3a0-3d0538066fc4 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:33.100346 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-6b749ce0-f2e3-42f2-b3a0-3d0538066fc4 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:33.100774 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-6b749ce0-f2e3-42f2-b3a0-3d0538066fc4 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:33.236829 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-6b749ce0-f2e3-42f2-b3a0-3d0538066fc4 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86d1ec821814f628879590513702cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5daf9e9245447dac44278ce813b4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:39:33.244847 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-6b749ce0-f2e3-42f2-b3a0-3d0538066fc4 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] 10.222.0.23 "GET /compute/v2.1/servers/667d78d5-e585-4ce5-a240-797cf2202816" status: 200 len: 1358 microversion: 2.1 time: 0.160926 Sep 09 16:39:33.245653 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 458/927] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:39:33 2022] GET /compute/v2.1/servers/667d78d5-e585-4ce5-a240-797cf2202816 => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:39:33.975757 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-e660d294-cb69-4525-917f-898a04efbeed tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:39:33.976443 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-e660d294-cb69-4525-917f-898a04efbeed tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] [instance: ce8ce7fc-5de7-4d65-b26b-e1a60b59f8a1] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:39:33.982819 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e660d294-cb69-4525-917f-898a04efbeed tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:33.983394 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e660d294-cb69-4525-917f-898a04efbeed tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:33.983857 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e660d294-cb69-4525-917f-898a04efbeed tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:33.984569 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e660d294-cb69-4525-917f-898a04efbeed tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:33.985020 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e660d294-cb69-4525-917f-898a04efbeed tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:33.985444 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e660d294-cb69-4525-917f-898a04efbeed tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:34.010426 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-e660d294-cb69-4525-917f-898a04efbeed tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] [instance: ce8ce7fc-5de7-4d65-b26b-e1a60b59f8a1] Going to try to terminate instance {{(pid=127198) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 16:39:34.093248 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-e660d294-cb69-4525-917f-898a04efbeed tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ce8ce7fc-5de7-4d65-b26b-e1a60b59f8a1" status: 204 len: 0 microversion: 2.1 time: 0.121931 Sep 09 16:39:34.093848 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 470/928] 10.222.0.23 () {58 vars in 1239 bytes} [Fri Sep 9 16:39:33 2022] DELETE /compute/v2.1/servers/ce8ce7fc-5de7-4d65-b26b-e1a60b59f8a1 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 16:39:34.102622 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-723ef73f-41dc-4604-90f7-4fed2dbc8147 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:39:34.103831 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-723ef73f-41dc-4604-90f7-4fed2dbc8147 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] [instance: ce8ce7fc-5de7-4d65-b26b-e1a60b59f8a1] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:39:34.106424 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG dbcounter [-] [127196] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=1 {{(pid=127196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:39:34.112364 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-723ef73f-41dc-4604-90f7-4fed2dbc8147 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:34.115937 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-723ef73f-41dc-4604-90f7-4fed2dbc8147 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:34.115937 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-723ef73f-41dc-4604-90f7-4fed2dbc8147 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:34.115937 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-723ef73f-41dc-4604-90f7-4fed2dbc8147 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:34.115937 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-723ef73f-41dc-4604-90f7-4fed2dbc8147 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:34.116431 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-723ef73f-41dc-4604-90f7-4fed2dbc8147 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:34.258470 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-723ef73f-41dc-4604-90f7-4fed2dbc8147 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae302ea931a42b5938884e79c2ae381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c6c1e895b5a49009d67f5d7e0ab6058', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:39:34.266842 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-723ef73f-41dc-4604-90f7-4fed2dbc8147 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] 10.222.0.23 "GET /compute/v2.1/servers/ce8ce7fc-5de7-4d65-b26b-e1a60b59f8a1" status: 200 len: 1513 microversion: 2.1 time: 0.168180 Sep 09 16:39:34.267415 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 459/929] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:39:34 2022] GET /compute/v2.1/servers/ce8ce7fc-5de7-4d65-b26b-e1a60b59f8a1 => generated 1513 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:39:34.278808 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-c215de01-6c3a-4765-b462-9130d6e1e420 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:39:34.278808 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-c215de01-6c3a-4765-b462-9130d6e1e420 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] [instance: 667d78d5-e585-4ce5-a240-797cf2202816] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:39:34.278808 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c215de01-6c3a-4765-b462-9130d6e1e420 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:34.278808 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c215de01-6c3a-4765-b462-9130d6e1e420 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:34.279244 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c215de01-6c3a-4765-b462-9130d6e1e420 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:34.279244 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c215de01-6c3a-4765-b462-9130d6e1e420 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:34.279244 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c215de01-6c3a-4765-b462-9130d6e1e420 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:34.279244 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c215de01-6c3a-4765-b462-9130d6e1e420 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:34.419333 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-c215de01-6c3a-4765-b462-9130d6e1e420 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86d1ec821814f628879590513702cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5daf9e9245447dac44278ce813b4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:39:34.431032 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-c215de01-6c3a-4765-b462-9130d6e1e420 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] 10.222.0.23 "GET /compute/v2.1/servers/667d78d5-e585-4ce5-a240-797cf2202816" status: 200 len: 1358 microversion: 2.1 time: 0.166190 Sep 09 16:39:34.431798 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 471/930] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:39:34 2022] GET /compute/v2.1/servers/667d78d5-e585-4ce5-a240-797cf2202816 => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:39:35.291944 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-32a25a0d-ef7b-4f36-be13-ab462843f49c tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:39:35.292551 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-32a25a0d-ef7b-4f36-be13-ab462843f49c tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] [instance: ce8ce7fc-5de7-4d65-b26b-e1a60b59f8a1] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:39:35.298910 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-32a25a0d-ef7b-4f36-be13-ab462843f49c tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:35.299385 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-32a25a0d-ef7b-4f36-be13-ab462843f49c tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:35.299812 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-32a25a0d-ef7b-4f36-be13-ab462843f49c tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:35.300495 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-32a25a0d-ef7b-4f36-be13-ab462843f49c tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:35.300946 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-32a25a0d-ef7b-4f36-be13-ab462843f49c tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:35.301355 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-32a25a0d-ef7b-4f36-be13-ab462843f49c tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:35.448966 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-32a25a0d-ef7b-4f36-be13-ab462843f49c tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae302ea931a42b5938884e79c2ae381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c6c1e895b5a49009d67f5d7e0ab6058', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:39:35.458112 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-d346931d-2176-4d92-b49d-d317a92ecdb4 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:39:35.460199 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-d346931d-2176-4d92-b49d-d317a92ecdb4 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] [instance: 667d78d5-e585-4ce5-a240-797cf2202816] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:39:35.473631 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-32a25a0d-ef7b-4f36-be13-ab462843f49c tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] 10.222.0.23 "GET /compute/v2.1/servers/ce8ce7fc-5de7-4d65-b26b-e1a60b59f8a1" status: 200 len: 1513 microversion: 2.1 time: 0.185411 Sep 09 16:39:35.474061 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d346931d-2176-4d92-b49d-d317a92ecdb4 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:35.474213 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 460/931] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:39:35 2022] GET /compute/v2.1/servers/ce8ce7fc-5de7-4d65-b26b-e1a60b59f8a1 => generated 1513 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 16:39:35.474862 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d346931d-2176-4d92-b49d-d317a92ecdb4 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:35.476150 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d346931d-2176-4d92-b49d-d317a92ecdb4 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:35.477184 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d346931d-2176-4d92-b49d-d317a92ecdb4 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:35.477786 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d346931d-2176-4d92-b49d-d317a92ecdb4 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:35.478371 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d346931d-2176-4d92-b49d-d317a92ecdb4 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:35.617827 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-d346931d-2176-4d92-b49d-d317a92ecdb4 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86d1ec821814f628879590513702cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5daf9e9245447dac44278ce813b4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:39:35.625595 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-d346931d-2176-4d92-b49d-d317a92ecdb4 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] 10.222.0.23 "GET /compute/v2.1/servers/667d78d5-e585-4ce5-a240-797cf2202816" status: 200 len: 1358 microversion: 2.1 time: 0.173097 Sep 09 16:39:35.627431 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 472/932] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:39:35 2022] GET /compute/v2.1/servers/667d78d5-e585-4ce5-a240-797cf2202816 => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:39:36.496761 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-b630d56f-9955-4a94-ac1a-a01f88523f18 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:39:36.497961 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-b630d56f-9955-4a94-ac1a-a01f88523f18 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] [instance: ce8ce7fc-5de7-4d65-b26b-e1a60b59f8a1] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:39:36.505378 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-b630d56f-9955-4a94-ac1a-a01f88523f18 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:36.505914 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-b630d56f-9955-4a94-ac1a-a01f88523f18 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:36.506316 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-b630d56f-9955-4a94-ac1a-a01f88523f18 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:36.507364 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-b630d56f-9955-4a94-ac1a-a01f88523f18 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:36.507802 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-b630d56f-9955-4a94-ac1a-a01f88523f18 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:36.508213 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-b630d56f-9955-4a94-ac1a-a01f88523f18 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:36.649478 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-ccec96d9-bc29-4352-b8fa-91ebea0c8374 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:39:36.650072 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-ccec96d9-bc29-4352-b8fa-91ebea0c8374 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] [instance: 667d78d5-e585-4ce5-a240-797cf2202816] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:39:36.656950 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ccec96d9-bc29-4352-b8fa-91ebea0c8374 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:36.657485 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ccec96d9-bc29-4352-b8fa-91ebea0c8374 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:36.658009 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ccec96d9-bc29-4352-b8fa-91ebea0c8374 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:36.658753 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ccec96d9-bc29-4352-b8fa-91ebea0c8374 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:36.659256 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ccec96d9-bc29-4352-b8fa-91ebea0c8374 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:36.659677 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ccec96d9-bc29-4352-b8fa-91ebea0c8374 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:36.710310 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-b630d56f-9955-4a94-ac1a-a01f88523f18 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae302ea931a42b5938884e79c2ae381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c6c1e895b5a49009d67f5d7e0ab6058', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:39:36.744348 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-b630d56f-9955-4a94-ac1a-a01f88523f18 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] 10.222.0.23 "GET /compute/v2.1/servers/ce8ce7fc-5de7-4d65-b26b-e1a60b59f8a1" status: 200 len: 1513 microversion: 2.1 time: 0.251539 Sep 09 16:39:36.745482 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 461/933] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:39:36 2022] GET /compute/v2.1/servers/ce8ce7fc-5de7-4d65-b26b-e1a60b59f8a1 => generated 1513 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:39:36.902031 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-ccec96d9-bc29-4352-b8fa-91ebea0c8374 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86d1ec821814f628879590513702cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5daf9e9245447dac44278ce813b4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:39:36.910391 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-ccec96d9-bc29-4352-b8fa-91ebea0c8374 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] 10.222.0.23 "GET /compute/v2.1/servers/667d78d5-e585-4ce5-a240-797cf2202816" status: 200 len: 1358 microversion: 2.1 time: 0.264859 Sep 09 16:39:36.911002 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 473/934] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:39:36 2022] GET /compute/v2.1/servers/667d78d5-e585-4ce5-a240-797cf2202816 => generated 1358 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:39:36.957874 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [req-a168ce24-5d4d-4f59-bff2-3f9db3857d0c req-4d9c6621-adeb-4f5d-a745-17b95d333bce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce8ce7fc-5de7-4d65-b26b-e1a60b59f8a1", "name": "network-vif-deleted", "tag": "d70b166f-7e9b-4c46-b61a-8c8c2772b6d2"}]} {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:39:36.967793 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [req-a168ce24-5d4d-4f59-bff2-3f9db3857d0c req-4d9c6621-adeb-4f5d-a745-17b95d333bce service nova] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:36.968280 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [req-a168ce24-5d4d-4f59-bff2-3f9db3857d0c req-4d9c6621-adeb-4f5d-a745-17b95d333bce service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:36.968736 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [req-a168ce24-5d4d-4f59-bff2-3f9db3857d0c req-4d9c6621-adeb-4f5d-a745-17b95d333bce service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:36.980029 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.compute.server_external_events [req-a168ce24-5d4d-4f59-bff2-3f9db3857d0c req-4d9c6621-adeb-4f5d-a745-17b95d333bce service nova] Creating event network-vif-deleted:d70b166f-7e9b-4c46-b61a-8c8c2772b6d2 for instance ce8ce7fc-5de7-4d65-b26b-e1a60b59f8a1 on hv-cinder-83124 Sep 09 16:39:36.985144 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [req-a168ce24-5d4d-4f59-bff2-3f9db3857d0c req-4d9c6621-adeb-4f5d-a745-17b95d333bce service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031011 Sep 09 16:39:36.985949 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 462/935] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Sep 9 16:39:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:39:37.155522 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [req-6b2e4b32-51fa-42cd-8087-7b20aa5c0034 req-0d15585a-5fed-41a7-849c-119b0690bcb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "667d78d5-e585-4ce5-a240-797cf2202816", "name": "network-vif-plugged", "status": "completed", "tag": "5d5ee3f8-848f-4ebf-b6d0-9b071a89552e"}]} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:39:37.169673 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-6b2e4b32-51fa-42cd-8087-7b20aa5c0034 req-0d15585a-5fed-41a7-849c-119b0690bcb0 service nova] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:37.170399 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-6b2e4b32-51fa-42cd-8087-7b20aa5c0034 req-0d15585a-5fed-41a7-849c-119b0690bcb0 service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:37.170902 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-6b2e4b32-51fa-42cd-8087-7b20aa5c0034 req-0d15585a-5fed-41a7-849c-119b0690bcb0 service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:37.185165 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.compute.server_external_events [req-6b2e4b32-51fa-42cd-8087-7b20aa5c0034 req-0d15585a-5fed-41a7-849c-119b0690bcb0 service nova] Creating event network-vif-plugged:5d5ee3f8-848f-4ebf-b6d0-9b071a89552e for instance 667d78d5-e585-4ce5-a240-797cf2202816 on hv-cinder-83124 Sep 09 16:39:37.190747 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [req-6b2e4b32-51fa-42cd-8087-7b20aa5c0034 req-0d15585a-5fed-41a7-849c-119b0690bcb0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039956 Sep 09 16:39:37.191349 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 474/936] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Sep 9 16:39:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 16:39:37.768642 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-d8d31535-f4ec-4e35-a55e-7dc8f4898b12 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:39:37.769338 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-d8d31535-f4ec-4e35-a55e-7dc8f4898b12 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] [instance: ce8ce7fc-5de7-4d65-b26b-e1a60b59f8a1] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:39:37.775435 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-d8d31535-f4ec-4e35-a55e-7dc8f4898b12 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:37.775910 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-d8d31535-f4ec-4e35-a55e-7dc8f4898b12 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:37.776335 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-d8d31535-f4ec-4e35-a55e-7dc8f4898b12 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:37.777010 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-d8d31535-f4ec-4e35-a55e-7dc8f4898b12 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:37.777668 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-d8d31535-f4ec-4e35-a55e-7dc8f4898b12 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:37.778087 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-d8d31535-f4ec-4e35-a55e-7dc8f4898b12 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:37.792789 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.wsgi [None req-d8d31535-f4ec-4e35-a55e-7dc8f4898b12 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] HTTP exception thrown: Instance ce8ce7fc-5de7-4d65-b26b-e1a60b59f8a1 could not be found. Sep 09 16:39:37.794441 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-d8d31535-f4ec-4e35-a55e-7dc8f4898b12 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Request method failure captured: Sep 09 16:39:37.794441 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: request: GET /compute/v2.1/servers/ce8ce7fc-5de7-4d65-b26b-e1a60b59f8a1 HTTP/1.1 Sep 09 16:39:37.794441 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Accept: application/json Sep 09 16:39:37.794441 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Accept-Encoding: identity Sep 09 16:39:37.794441 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Connection: close Sep 09 16:39:37.794441 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Content-Length: 0 Sep 09 16:39:37.794441 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Content-Type: application/json Sep 09 16:39:37.794441 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Host: 10.222.0.23 Sep 09 16:39:37.794441 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Openstack-System-Scope: None Sep 09 16:39:37.794441 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: User-Agent: python-urllib3/1.26.12 Sep 09 16:39:37.794441 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Auth-Token: gAAAAABjG2v_crC6EjHdkptc_uB0kEsFOo25fN7AjhXYzEkU9a6jZfmpsuFxASJGdXyg37_XntIBAu6Om-6p79YpsKhBsy1lvy6WzXBKV_AI0rzCVN3jzGjmTaeC_Gcgqb9uocDFt0I9vbiiU2futN5uG0zOmW8gfZxJdwVttncJ8QYJfBRpJvE Sep 09 16:39:37.794441 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Domain-Id: None Sep 09 16:39:37.794441 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Domain-Name: None Sep 09 16:39:37.794441 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Identity-Status: Confirmed Sep 09 16:39:37.794441 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Is-Admin-Project: True Sep 09 16:39:37.794441 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Project-Domain-Id: default Sep 09 16:39:37.794441 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Project-Domain-Name: Default Sep 09 16:39:37.794441 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Project-Id: 1c6c1e895b5a49009d67f5d7e0ab6058 Sep 09 16:39:37.794441 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1643251043 Sep 09 16:39:37.794441 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Role: member,reader Sep 09 16:39:37.794441 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Roles: member,reader Sep 09 16:39:37.796303 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1c6c1e895b5a49009d67f5d7e0ab6058"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1c6c1e895b5a49009d67f5d7e0ab6058"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1c6c1e895b5a49009d67f5d7e0ab6058"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1c6c1e895b5a49009d67f5d7e0ab6058"}]}] Sep 09 16:39:37.796303 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Tenant: tempest-VolumesSnapshotTestJSON-1643251043 Sep 09 16:39:37.796303 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Tenant-Id: 1c6c1e895b5a49009d67f5d7e0ab6058 Sep 09 16:39:37.796303 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1643251043 Sep 09 16:39:37.796303 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-User: tempest-VolumesSnapshotTestJSON-1643251043-project Sep 09 16:39:37.796303 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-User-Domain-Id: default Sep 09 16:39:37.796303 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-User-Domain-Name: Default Sep 09 16:39:37.796303 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-User-Id: 5ae302ea931a42b5938884e79c2ae381 Sep 09 16:39:37.796303 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-User-Name: tempest-VolumesSnapshotTestJSON-1643251043-project Sep 09 16:39:37.796303 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: method: > Sep 09 16:39:37.796303 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: exception: Instance ce8ce7fc-5de7-4d65-b26b-e1a60b59f8a1 could not be found. Sep 09 16:39:37.796303 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: action_args: {'id': 'ce8ce7fc-5de7-4d65-b26b-e1a60b59f8a1'} Sep 09 16:39:37.797476 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 16:39:37.797476 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:39:37.797476 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 16:39:37.797476 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 16:39:37.797476 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 16:39:37.797476 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 16:39:37.797476 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 16:39:37.797476 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 16:39:37.797476 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 16:39:37.797476 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 16:39:37.797476 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce8ce7fc-5de7-4d65-b26b-e1a60b59f8a1 could not be found. Sep 09 16:39:37.797476 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Sep 09 16:39:37.797476 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 16:39:37.797476 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Sep 09 16:39:37.797476 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:39:37.797476 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 16:39:37.797476 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 16:39:37.797476 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 16:39:37.797476 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 16:39:37.797476 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 16:39:37.806180 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 16:39:37.806180 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 16:39:37.806180 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 16:39:37.806180 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 16:39:37.806180 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 16:39:37.806180 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 16:39:37.806180 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 16:39:37.806180 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce8ce7fc-5de7-4d65-b26b-e1a60b59f8a1 could not be found. Sep 09 16:39:37.806180 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Sep 09 16:39:37.806180 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 16:39:37.806180 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Sep 09 16:39:37.806180 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:39:37.806180 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 16:39:37.806180 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 16:39:37.806180 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 16:39:37.806180 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 16:39:37.806180 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce8ce7fc-5de7-4d65-b26b-e1a60b59f8a1 could not be found. Sep 09 16:39:37.806180 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Sep 09 16:39:37.809581 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-d8d31535-f4ec-4e35-a55e-7dc8f4898b12 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Returning 404 to user: Instance ce8ce7fc-5de7-4d65-b26b-e1a60b59f8a1 could not be found. {{(pid=127196) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 16:39:37.809581 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-d8d31535-f4ec-4e35-a55e-7dc8f4898b12 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] 10.222.0.23 "GET /compute/v2.1/servers/ce8ce7fc-5de7-4d65-b26b-e1a60b59f8a1" status: 404 len: 111 microversion: 2.1 time: 0.032283 Sep 09 16:39:37.809581 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 463/937] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:39:37 2022] GET /compute/v2.1/servers/ce8ce7fc-5de7-4d65-b26b-e1a60b59f8a1 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 16:39:37.942097 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-07e4b5e4-e294-416d-bfb9-f150e2129b87 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:39:37.954254 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-07e4b5e4-e294-416d-bfb9-f150e2129b87 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] [instance: 667d78d5-e585-4ce5-a240-797cf2202816] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:39:37.966420 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-07e4b5e4-e294-416d-bfb9-f150e2129b87 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:37.966945 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-07e4b5e4-e294-416d-bfb9-f150e2129b87 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:37.967424 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-07e4b5e4-e294-416d-bfb9-f150e2129b87 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:37.968131 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-07e4b5e4-e294-416d-bfb9-f150e2129b87 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:37.968583 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-07e4b5e4-e294-416d-bfb9-f150e2129b87 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:37.969000 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-07e4b5e4-e294-416d-bfb9-f150e2129b87 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:38.120121 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-07e4b5e4-e294-416d-bfb9-f150e2129b87 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86d1ec821814f628879590513702cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5daf9e9245447dac44278ce813b4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:39:38.128383 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-07e4b5e4-e294-416d-bfb9-f150e2129b87 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] 10.222.0.23 "GET /compute/v2.1/servers/667d78d5-e585-4ce5-a240-797cf2202816" status: 200 len: 1358 microversion: 2.1 time: 0.191231 Sep 09 16:39:38.128941 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 475/938] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:39:37 2022] GET /compute/v2.1/servers/667d78d5-e585-4ce5-a240-797cf2202816 => generated 1358 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:39:39.152089 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-76ad0c2a-0667-4813-a319-329a3910ba89 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:39:39.152919 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-76ad0c2a-0667-4813-a319-329a3910ba89 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] [instance: 667d78d5-e585-4ce5-a240-797cf2202816] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:39:39.160215 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-76ad0c2a-0667-4813-a319-329a3910ba89 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:39.160716 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-76ad0c2a-0667-4813-a319-329a3910ba89 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:39.161149 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-76ad0c2a-0667-4813-a319-329a3910ba89 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:39.162268 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-76ad0c2a-0667-4813-a319-329a3910ba89 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:39.162936 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-76ad0c2a-0667-4813-a319-329a3910ba89 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:39.163415 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-76ad0c2a-0667-4813-a319-329a3910ba89 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:39.301347 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-76ad0c2a-0667-4813-a319-329a3910ba89 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86d1ec821814f628879590513702cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5daf9e9245447dac44278ce813b4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:39:39.309339 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-76ad0c2a-0667-4813-a319-329a3910ba89 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] 10.222.0.23 "GET /compute/v2.1/servers/667d78d5-e585-4ce5-a240-797cf2202816" status: 200 len: 1358 microversion: 2.1 time: 0.161305 Sep 09 16:39:39.309913 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 464/939] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:39:39 2022] GET /compute/v2.1/servers/667d78d5-e585-4ce5-a240-797cf2202816 => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:39:40.336688 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-eafa24e0-4ecc-4096-97f0-801c9fba7dc2 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:39:40.337534 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-eafa24e0-4ecc-4096-97f0-801c9fba7dc2 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] [instance: 667d78d5-e585-4ce5-a240-797cf2202816] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:39:40.346794 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-eafa24e0-4ecc-4096-97f0-801c9fba7dc2 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:40.347281 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-eafa24e0-4ecc-4096-97f0-801c9fba7dc2 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:40.347711 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-eafa24e0-4ecc-4096-97f0-801c9fba7dc2 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:40.348413 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-eafa24e0-4ecc-4096-97f0-801c9fba7dc2 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:40.348861 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-eafa24e0-4ecc-4096-97f0-801c9fba7dc2 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:40.349621 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-eafa24e0-4ecc-4096-97f0-801c9fba7dc2 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:40.486067 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-eafa24e0-4ecc-4096-97f0-801c9fba7dc2 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86d1ec821814f628879590513702cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5daf9e9245447dac44278ce813b4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:39:40.494200 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-eafa24e0-4ecc-4096-97f0-801c9fba7dc2 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] 10.222.0.23 "GET /compute/v2.1/servers/667d78d5-e585-4ce5-a240-797cf2202816" status: 200 len: 1358 microversion: 2.1 time: 0.164226 Sep 09 16:39:40.494836 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 476/940] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:39:40 2022] GET /compute/v2.1/servers/667d78d5-e585-4ce5-a240-797cf2202816 => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:39:41.521667 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-12cd4daf-0d76-4d42-9fd8-39e3d0c8e96a tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:39:41.522611 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-12cd4daf-0d76-4d42-9fd8-39e3d0c8e96a tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] [instance: 667d78d5-e585-4ce5-a240-797cf2202816] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:39:41.533760 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-12cd4daf-0d76-4d42-9fd8-39e3d0c8e96a tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:41.534571 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-12cd4daf-0d76-4d42-9fd8-39e3d0c8e96a tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:41.535312 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-12cd4daf-0d76-4d42-9fd8-39e3d0c8e96a tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:41.536825 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-12cd4daf-0d76-4d42-9fd8-39e3d0c8e96a tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:41.537582 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-12cd4daf-0d76-4d42-9fd8-39e3d0c8e96a tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:41.538274 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-12cd4daf-0d76-4d42-9fd8-39e3d0c8e96a tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:41.680413 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-12cd4daf-0d76-4d42-9fd8-39e3d0c8e96a tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86d1ec821814f628879590513702cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5daf9e9245447dac44278ce813b4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:39:41.689021 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-12cd4daf-0d76-4d42-9fd8-39e3d0c8e96a tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] 10.222.0.23 "GET /compute/v2.1/servers/667d78d5-e585-4ce5-a240-797cf2202816" status: 200 len: 1358 microversion: 2.1 time: 0.174140 Sep 09 16:39:41.689657 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 465/941] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:39:41 2022] GET /compute/v2.1/servers/667d78d5-e585-4ce5-a240-797cf2202816 => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:39:42.715382 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-d904d7bd-87e4-45ab-ade5-55d24f2a9fb1 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:39:42.716286 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-d904d7bd-87e4-45ab-ade5-55d24f2a9fb1 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] [instance: 667d78d5-e585-4ce5-a240-797cf2202816] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:39:42.723518 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d904d7bd-87e4-45ab-ade5-55d24f2a9fb1 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:42.724004 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d904d7bd-87e4-45ab-ade5-55d24f2a9fb1 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:42.724438 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d904d7bd-87e4-45ab-ade5-55d24f2a9fb1 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:42.725130 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d904d7bd-87e4-45ab-ade5-55d24f2a9fb1 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:42.725585 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d904d7bd-87e4-45ab-ade5-55d24f2a9fb1 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:42.726008 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d904d7bd-87e4-45ab-ade5-55d24f2a9fb1 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:42.854367 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-d904d7bd-87e4-45ab-ade5-55d24f2a9fb1 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86d1ec821814f628879590513702cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5daf9e9245447dac44278ce813b4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:39:42.867428 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-d904d7bd-87e4-45ab-ade5-55d24f2a9fb1 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] 10.222.0.23 "GET /compute/v2.1/servers/667d78d5-e585-4ce5-a240-797cf2202816" status: 200 len: 1547 microversion: 2.1 time: 0.158068 Sep 09 16:39:42.868101 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 477/942] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:39:42 2022] GET /compute/v2.1/servers/667d78d5-e585-4ce5-a240-797cf2202816 => generated 1547 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:39:42.891013 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-06ad8d3e-c247-4184-833c-0e835211caa2 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:39:42.891615 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-06ad8d3e-c247-4184-833c-0e835211caa2 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] [instance: 667d78d5-e585-4ce5-a240-797cf2202816] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:39:42.898087 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-06ad8d3e-c247-4184-833c-0e835211caa2 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:42.898593 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-06ad8d3e-c247-4184-833c-0e835211caa2 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:42.899049 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-06ad8d3e-c247-4184-833c-0e835211caa2 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:42.899732 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-06ad8d3e-c247-4184-833c-0e835211caa2 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:42.900901 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-06ad8d3e-c247-4184-833c-0e835211caa2 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:42.901338 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-06ad8d3e-c247-4184-833c-0e835211caa2 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:43.035023 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-06ad8d3e-c247-4184-833c-0e835211caa2 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86d1ec821814f628879590513702cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5daf9e9245447dac44278ce813b4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:39:43.043168 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-06ad8d3e-c247-4184-833c-0e835211caa2 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] 10.222.0.23 "GET /compute/v2.1/servers/667d78d5-e585-4ce5-a240-797cf2202816" status: 200 len: 1547 microversion: 2.1 time: 0.156060 Sep 09 16:39:43.043730 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 466/943] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:39:42 2022] GET /compute/v2.1/servers/667d78d5-e585-4ce5-a240-797cf2202816 => generated 1547 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:39:43.065092 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-964f66f0-7dbe-4af5-8b28-a71e9f52cf50 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:39:43.069849 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-964f66f0-7dbe-4af5-8b28-a71e9f52cf50 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f86d1ec821814f628879590513702cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5daf9e9245447dac44278ce813b4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:39:43.070615 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-964f66f0-7dbe-4af5-8b28-a71e9f52cf50 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Searching by: {'deleted': False, 'project_id': 'ff5daf9e9245447dac44278ce813b4a0'} {{(pid=127198) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 09 16:39:43.077404 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-964f66f0-7dbe-4af5-8b28-a71e9f52cf50 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:43.077876 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-964f66f0-7dbe-4af5-8b28-a71e9f52cf50 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:43.078308 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-964f66f0-7dbe-4af5-8b28-a71e9f52cf50 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:43.079078 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-964f66f0-7dbe-4af5-8b28-a71e9f52cf50 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:43.079531 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-964f66f0-7dbe-4af5-8b28-a71e9f52cf50 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:43.079947 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-964f66f0-7dbe-4af5-8b28-a71e9f52cf50 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:43.175874 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.multi_cell_list [None req-964f66f0-7dbe-4af5-8b28-a71e9f52cf50 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127198) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 09 16:39:43.269737 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-964f66f0-7dbe-4af5-8b28-a71e9f52cf50 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] 10.222.0.23 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.208460 Sep 09 16:39:43.270215 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 478/944] 10.222.0.23 () {58 vars in 1125 bytes} [Fri Sep 9 16:39:43 2022] GET /compute/v2.1/servers => generated 343 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:39:43.283174 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-562e5b7f-1aeb-4250-a01d-77f2960f1a3a tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:39:43.283782 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-562e5b7f-1aeb-4250-a01d-77f2960f1a3a tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] [instance: 667d78d5-e585-4ce5-a240-797cf2202816] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:39:43.290533 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-562e5b7f-1aeb-4250-a01d-77f2960f1a3a tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:43.291048 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-562e5b7f-1aeb-4250-a01d-77f2960f1a3a tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:43.291476 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-562e5b7f-1aeb-4250-a01d-77f2960f1a3a tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:43.292168 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-562e5b7f-1aeb-4250-a01d-77f2960f1a3a tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:43.292629 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-562e5b7f-1aeb-4250-a01d-77f2960f1a3a tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:43.293048 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-562e5b7f-1aeb-4250-a01d-77f2960f1a3a tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:43.421045 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-562e5b7f-1aeb-4250-a01d-77f2960f1a3a tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86d1ec821814f628879590513702cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5daf9e9245447dac44278ce813b4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:39:43.429342 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-562e5b7f-1aeb-4250-a01d-77f2960f1a3a tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] 10.222.0.23 "GET /compute/v2.1/servers/667d78d5-e585-4ce5-a240-797cf2202816" status: 200 len: 1547 microversion: 2.1 time: 0.150796 Sep 09 16:39:43.429909 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 467/945] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:39:43 2022] GET /compute/v2.1/servers/667d78d5-e585-4ce5-a240-797cf2202816 => generated 1547 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:39:45.719436 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-9bbb6899-c337-41b5-b52a-96b2fd16e173 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-482522756", "imageRef": "0b1ba34f-2223-497a-9a18-c2ad8d398aae", "flavorRef": "452", "networks": [{"uuid": "56f30ac1-7605-4504-858d-85506b8560e0"}]}} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:39:45.773122 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.network.neutron [None req-9bbb6899-c337-41b5-b52a-96b2fd16e173 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] validate_networks() for [('56f30ac1-7605-4504-858d-85506b8560e0', None, None, None, None, None)] {{(pid=127198) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 16:39:46.054480 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-9181d961-56fb-406b-a1f5-176562d7ede6 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5e6c7b83-a2e0-4e92-a828-b5ca6a302ed2"}} {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:39:46.056949 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-9181d961-56fb-406b-a1f5-176562d7ede6 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] [instance: 667d78d5-e585-4ce5-a240-797cf2202816] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:39:46.063202 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-9181d961-56fb-406b-a1f5-176562d7ede6 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:46.063684 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-9181d961-56fb-406b-a1f5-176562d7ede6 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:46.064070 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-9181d961-56fb-406b-a1f5-176562d7ede6 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:46.064964 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-9181d961-56fb-406b-a1f5-176562d7ede6 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:46.065414 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-9181d961-56fb-406b-a1f5-176562d7ede6 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:46.065832 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-9181d961-56fb-406b-a1f5-176562d7ede6 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:46.126052 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-9bbb6899-c337-41b5-b52a-96b2fd16e173 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Flavor limits 0:0:0 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 16:39:46.126915 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-9bbb6899-c337-41b5-b52a-96b2fd16e173 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Image limits 0:0:0 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 16:39:46.127402 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-9bbb6899-c337-41b5-b52a-96b2fd16e173 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Flavor pref 0:0:0 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 16:39:46.127849 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-9bbb6899-c337-41b5-b52a-96b2fd16e173 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Image pref 0:0:0 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 16:39:46.128398 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-9bbb6899-c337-41b5-b52a-96b2fd16e173 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 16:39:46.137445 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9bbb6899-c337-41b5-b52a-96b2fd16e173 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:46.137952 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9bbb6899-c337-41b5-b52a-96b2fd16e173 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:46.138380 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9bbb6899-c337-41b5-b52a-96b2fd16e173 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:46.139212 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9bbb6899-c337-41b5-b52a-96b2fd16e173 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:46.139675 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9bbb6899-c337-41b5-b52a-96b2fd16e173 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:46.140085 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9bbb6899-c337-41b5-b52a-96b2fd16e173 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:46.158803 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.quota [None req-9bbb6899-c337-41b5-b52a-96b2fd16e173 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Getting quotas for project 1c6c1e895b5a49009d67f5d7e0ab6058. Resources: {'cores', 'instances', 'ram'} {{(pid=127198) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 16:39:46.163441 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.quota [None req-9bbb6899-c337-41b5-b52a-96b2fd16e173 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Getting quotas for user 5ae302ea931a42b5938884e79c2ae381 and project 1c6c1e895b5a49009d67f5d7e0ab6058. Resources: {'cores', 'instances', 'ram'} {{(pid=127198) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 16:39:46.176206 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-9bbb6899-c337-41b5-b52a-96b2fd16e173 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Going to run 1 instances... {{(pid=127198) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 16:39:46.178593 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-9bbb6899-c337-41b5-b52a-96b2fd16e173 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] [instance: 288920f8-c6ff-4a73-a792-1018854830f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0b1ba34f-2223-497a-9a18-c2ad8d398aae',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127198) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 16:39:46.231886 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-9bbb6899-c337-41b5-b52a-96b2fd16e173 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.516409 Sep 09 16:39:46.232728 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 479/946] 10.222.0.23 () {60 vars in 1147 bytes} [Fri Sep 9 16:39:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 518 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 16:39:46.251753 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-a33b6b27-f476-416e-97e5-5501158244cf tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:39:46.252375 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-a33b6b27-f476-416e-97e5-5501158244cf tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] [instance: 288920f8-c6ff-4a73-a792-1018854830f3] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:39:46.311681 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-a33b6b27-f476-416e-97e5-5501158244cf tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae302ea931a42b5938884e79c2ae381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c6c1e895b5a49009d67f5d7e0ab6058', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:39:46.319456 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-a33b6b27-f476-416e-97e5-5501158244cf tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] 10.222.0.23 "GET /compute/v2.1/servers/288920f8-c6ff-4a73-a792-1018854830f3" status: 200 len: 1218 microversion: 2.1 time: 0.073385 Sep 09 16:39:46.320950 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 480/947] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:39:46 2022] GET /compute/v2.1/servers/288920f8-c6ff-4a73-a792-1018854830f3 => generated 1218 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:39:46.323222 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-9181d961-56fb-406b-a1f5-176562d7ede6 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] 10.222.0.23 "POST /compute/v2.1/servers/667d78d5-e585-4ce5-a240-797cf2202816/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.272668 Sep 09 16:39:46.329146 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 468/948] 10.222.0.23 () {60 vars in 1323 bytes} [Fri Sep 9 16:39:46 2022] POST /compute/v2.1/servers/667d78d5-e585-4ce5-a240-797cf2202816/os-volume_attachments => generated 194 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 16:39:47.344430 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-40a81132-8414-4058-bd65-701bf95fef93 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:39:47.344963 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-40a81132-8414-4058-bd65-701bf95fef93 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] [instance: 288920f8-c6ff-4a73-a792-1018854830f3] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:39:47.351944 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-40a81132-8414-4058-bd65-701bf95fef93 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:47.352457 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-40a81132-8414-4058-bd65-701bf95fef93 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:47.352906 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-40a81132-8414-4058-bd65-701bf95fef93 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:47.353673 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-40a81132-8414-4058-bd65-701bf95fef93 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:47.354197 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-40a81132-8414-4058-bd65-701bf95fef93 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:47.354630 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-40a81132-8414-4058-bd65-701bf95fef93 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:47.370952 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:39:47.442210 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-40a81132-8414-4058-bd65-701bf95fef93 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae302ea931a42b5938884e79c2ae381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c6c1e895b5a49009d67f5d7e0ab6058', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:39:47.452278 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-40a81132-8414-4058-bd65-701bf95fef93 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] 10.222.0.23 "GET /compute/v2.1/servers/288920f8-c6ff-4a73-a792-1018854830f3" status: 200 len: 1278 microversion: 2.1 time: 0.111889 Sep 09 16:39:47.453398 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 481/949] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:39:47 2022] GET /compute/v2.1/servers/288920f8-c6ff-4a73-a792-1018854830f3 => generated 1278 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:39:48.475868 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-e3df5189-7546-44fc-955c-68b93426d5e9 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:39:48.476567 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-e3df5189-7546-44fc-955c-68b93426d5e9 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] [instance: 288920f8-c6ff-4a73-a792-1018854830f3] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:39:48.483651 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e3df5189-7546-44fc-955c-68b93426d5e9 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:48.484128 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e3df5189-7546-44fc-955c-68b93426d5e9 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:48.484553 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e3df5189-7546-44fc-955c-68b93426d5e9 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:48.485243 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e3df5189-7546-44fc-955c-68b93426d5e9 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:48.485688 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e3df5189-7546-44fc-955c-68b93426d5e9 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:48.486107 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e3df5189-7546-44fc-955c-68b93426d5e9 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:48.490533 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG dbcounter [-] [127196] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=127196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:39:48.706319 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-e3df5189-7546-44fc-955c-68b93426d5e9 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae302ea931a42b5938884e79c2ae381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c6c1e895b5a49009d67f5d7e0ab6058', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:39:48.714227 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-e3df5189-7546-44fc-955c-68b93426d5e9 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] 10.222.0.23 "GET /compute/v2.1/servers/288920f8-c6ff-4a73-a792-1018854830f3" status: 200 len: 1318 microversion: 2.1 time: 0.242571 Sep 09 16:39:48.714893 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 469/950] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:39:48 2022] GET /compute/v2.1/servers/288920f8-c6ff-4a73-a792-1018854830f3 => generated 1318 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:39:48.841011 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [req-ff744300-8023-4f46-a152-f9509935d587 req-ad952649-8101-4796-9e78-57cb913d2bee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "288920f8-c6ff-4a73-a792-1018854830f3", "tag": "722adc14-e173-400d-960f-cf3f1853fb54"}]} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:39:48.854705 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-ff744300-8023-4f46-a152-f9509935d587 req-ad952649-8101-4796-9e78-57cb913d2bee service nova] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:48.855678 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-ff744300-8023-4f46-a152-f9509935d587 req-ad952649-8101-4796-9e78-57cb913d2bee service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:48.856262 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-ff744300-8023-4f46-a152-f9509935d587 req-ad952649-8101-4796-9e78-57cb913d2bee service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:48.868746 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.compute.server_external_events [req-ff744300-8023-4f46-a152-f9509935d587 req-ad952649-8101-4796-9e78-57cb913d2bee service nova] Creating event network-changed:722adc14-e173-400d-960f-cf3f1853fb54 for instance 288920f8-c6ff-4a73-a792-1018854830f3 on hv-cinder-83124 Sep 09 16:39:48.874539 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [req-ff744300-8023-4f46-a152-f9509935d587 req-ad952649-8101-4796-9e78-57cb913d2bee service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037837 Sep 09 16:39:48.875445 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 482/951] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Sep 9 16:39:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:39:49.742102 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-98223310-dffd-4129-81ff-ddee451f81a5 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:39:49.743152 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-98223310-dffd-4129-81ff-ddee451f81a5 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] [instance: 288920f8-c6ff-4a73-a792-1018854830f3] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:39:49.754189 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-98223310-dffd-4129-81ff-ddee451f81a5 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:49.755042 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-98223310-dffd-4129-81ff-ddee451f81a5 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:49.755764 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-98223310-dffd-4129-81ff-ddee451f81a5 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:49.756911 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-98223310-dffd-4129-81ff-ddee451f81a5 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:49.757664 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-98223310-dffd-4129-81ff-ddee451f81a5 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:49.758366 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-98223310-dffd-4129-81ff-ddee451f81a5 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:49.891020 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-98223310-dffd-4129-81ff-ddee451f81a5 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae302ea931a42b5938884e79c2ae381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c6c1e895b5a49009d67f5d7e0ab6058', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:39:49.899216 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-98223310-dffd-4129-81ff-ddee451f81a5 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] 10.222.0.23 "GET /compute/v2.1/servers/288920f8-c6ff-4a73-a792-1018854830f3" status: 200 len: 1318 microversion: 2.1 time: 0.163707 Sep 09 16:39:49.899784 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 470/952] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:39:49 2022] GET /compute/v2.1/servers/288920f8-c6ff-4a73-a792-1018854830f3 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:39:50.927681 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-5607f979-7431-4fed-a5ff-84f1ac9bb3f6 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:39:50.928749 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-5607f979-7431-4fed-a5ff-84f1ac9bb3f6 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] [instance: 288920f8-c6ff-4a73-a792-1018854830f3] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:39:50.938333 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5607f979-7431-4fed-a5ff-84f1ac9bb3f6 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:50.938837 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5607f979-7431-4fed-a5ff-84f1ac9bb3f6 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:50.939263 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5607f979-7431-4fed-a5ff-84f1ac9bb3f6 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:50.939937 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5607f979-7431-4fed-a5ff-84f1ac9bb3f6 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:50.940472 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5607f979-7431-4fed-a5ff-84f1ac9bb3f6 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:50.940892 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5607f979-7431-4fed-a5ff-84f1ac9bb3f6 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:51.076055 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-5607f979-7431-4fed-a5ff-84f1ac9bb3f6 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae302ea931a42b5938884e79c2ae381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c6c1e895b5a49009d67f5d7e0ab6058', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:39:51.085005 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-5607f979-7431-4fed-a5ff-84f1ac9bb3f6 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] 10.222.0.23 "GET /compute/v2.1/servers/288920f8-c6ff-4a73-a792-1018854830f3" status: 200 len: 1318 microversion: 2.1 time: 0.164560 Sep 09 16:39:51.086349 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 483/953] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:39:50 2022] GET /compute/v2.1/servers/288920f8-c6ff-4a73-a792-1018854830f3 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:39:52.111501 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-f954124d-6647-483c-97ff-a4e78aa7f14c tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:39:52.112111 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-f954124d-6647-483c-97ff-a4e78aa7f14c tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] [instance: 288920f8-c6ff-4a73-a792-1018854830f3] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:39:52.118954 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f954124d-6647-483c-97ff-a4e78aa7f14c tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:52.119434 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f954124d-6647-483c-97ff-a4e78aa7f14c tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:52.119864 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f954124d-6647-483c-97ff-a4e78aa7f14c tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:52.120557 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f954124d-6647-483c-97ff-a4e78aa7f14c tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:52.121003 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f954124d-6647-483c-97ff-a4e78aa7f14c tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:52.121419 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f954124d-6647-483c-97ff-a4e78aa7f14c tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:52.259833 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-f954124d-6647-483c-97ff-a4e78aa7f14c tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae302ea931a42b5938884e79c2ae381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c6c1e895b5a49009d67f5d7e0ab6058', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:39:52.269422 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-f954124d-6647-483c-97ff-a4e78aa7f14c tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] 10.222.0.23 "GET /compute/v2.1/servers/288920f8-c6ff-4a73-a792-1018854830f3" status: 200 len: 1318 microversion: 2.1 time: 0.163254 Sep 09 16:39:52.269996 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 471/954] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:39:52 2022] GET /compute/v2.1/servers/288920f8-c6ff-4a73-a792-1018854830f3 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:39:53.213847 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [req-cc287d28-243e-40bf-8adb-bdf2d81914a9 req-f39883f3-0bd0-472b-b01c-82f8cac265a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "288920f8-c6ff-4a73-a792-1018854830f3", "name": "network-vif-plugged", "status": "completed", "tag": "722adc14-e173-400d-960f-cf3f1853fb54"}]} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:39:53.219864 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:39:53.227257 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-cc287d28-243e-40bf-8adb-bdf2d81914a9 req-f39883f3-0bd0-472b-b01c-82f8cac265a8 service nova] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:53.227739 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-cc287d28-243e-40bf-8adb-bdf2d81914a9 req-f39883f3-0bd0-472b-b01c-82f8cac265a8 service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:53.228175 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-cc287d28-243e-40bf-8adb-bdf2d81914a9 req-f39883f3-0bd0-472b-b01c-82f8cac265a8 service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:53.240307 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.compute.server_external_events [req-cc287d28-243e-40bf-8adb-bdf2d81914a9 req-f39883f3-0bd0-472b-b01c-82f8cac265a8 service nova] Creating event network-vif-plugged:722adc14-e173-400d-960f-cf3f1853fb54 for instance 288920f8-c6ff-4a73-a792-1018854830f3 on hv-cinder-83124 Sep 09 16:39:53.245238 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [req-cc287d28-243e-40bf-8adb-bdf2d81914a9 req-f39883f3-0bd0-472b-b01c-82f8cac265a8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035161 Sep 09 16:39:53.245800 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 484/955] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Sep 9 16:39:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:39:53.292720 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-410015c0-b559-435e-aecc-a56ac898e021 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:39:53.293877 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-410015c0-b559-435e-aecc-a56ac898e021 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] [instance: 288920f8-c6ff-4a73-a792-1018854830f3] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:39:53.301158 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-410015c0-b559-435e-aecc-a56ac898e021 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:53.301652 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-410015c0-b559-435e-aecc-a56ac898e021 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:53.302089 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-410015c0-b559-435e-aecc-a56ac898e021 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:53.302832 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-410015c0-b559-435e-aecc-a56ac898e021 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:53.303321 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-410015c0-b559-435e-aecc-a56ac898e021 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:53.303758 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-410015c0-b559-435e-aecc-a56ac898e021 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:53.464018 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-410015c0-b559-435e-aecc-a56ac898e021 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae302ea931a42b5938884e79c2ae381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c6c1e895b5a49009d67f5d7e0ab6058', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:39:53.472091 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-410015c0-b559-435e-aecc-a56ac898e021 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] 10.222.0.23 "GET /compute/v2.1/servers/288920f8-c6ff-4a73-a792-1018854830f3" status: 200 len: 1318 microversion: 2.1 time: 0.183402 Sep 09 16:39:53.472662 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 472/956] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:39:53 2022] GET /compute/v2.1/servers/288920f8-c6ff-4a73-a792-1018854830f3 => generated 1318 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 16:39:53.958525 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-6bf8d78f-b59b-40ac-9860-cb12629a4687 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:39:53.959224 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-6bf8d78f-b59b-40ac-9860-cb12629a4687 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] [instance: 667d78d5-e585-4ce5-a240-797cf2202816] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:39:53.966429 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6bf8d78f-b59b-40ac-9860-cb12629a4687 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:53.966933 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6bf8d78f-b59b-40ac-9860-cb12629a4687 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:53.967368 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6bf8d78f-b59b-40ac-9860-cb12629a4687 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:53.968057 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6bf8d78f-b59b-40ac-9860-cb12629a4687 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:53.968559 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6bf8d78f-b59b-40ac-9860-cb12629a4687 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:53.968989 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6bf8d78f-b59b-40ac-9860-cb12629a4687 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:54.120134 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-6bf8d78f-b59b-40ac-9860-cb12629a4687 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86d1ec821814f628879590513702cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5daf9e9245447dac44278ce813b4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:39:54.128645 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-6bf8d78f-b59b-40ac-9860-cb12629a4687 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] 10.222.0.23 "GET /compute/v2.1/servers/667d78d5-e585-4ce5-a240-797cf2202816" status: 200 len: 1593 microversion: 2.1 time: 0.174422 Sep 09 16:39:54.129215 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 485/957] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:39:53 2022] GET /compute/v2.1/servers/667d78d5-e585-4ce5-a240-797cf2202816 => generated 1593 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:39:54.495932 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-0a546a7b-6539-4d8e-b71b-c13a1117747b tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:39:54.496521 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-0a546a7b-6539-4d8e-b71b-c13a1117747b tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] [instance: 288920f8-c6ff-4a73-a792-1018854830f3] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:39:54.503109 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-0a546a7b-6539-4d8e-b71b-c13a1117747b tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:54.503598 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-0a546a7b-6539-4d8e-b71b-c13a1117747b tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:54.504009 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-0a546a7b-6539-4d8e-b71b-c13a1117747b tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:54.504716 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-0a546a7b-6539-4d8e-b71b-c13a1117747b tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:54.505163 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-0a546a7b-6539-4d8e-b71b-c13a1117747b tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:54.505578 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-0a546a7b-6539-4d8e-b71b-c13a1117747b tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:54.731541 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-0a546a7b-6539-4d8e-b71b-c13a1117747b tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae302ea931a42b5938884e79c2ae381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c6c1e895b5a49009d67f5d7e0ab6058', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:39:54.740138 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-0a546a7b-6539-4d8e-b71b-c13a1117747b tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] 10.222.0.23 "GET /compute/v2.1/servers/288920f8-c6ff-4a73-a792-1018854830f3" status: 200 len: 1318 microversion: 2.1 time: 0.248529 Sep 09 16:39:54.740714 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 473/958] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:39:54 2022] GET /compute/v2.1/servers/288920f8-c6ff-4a73-a792-1018854830f3 => generated 1318 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 16:39:55.764238 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-da8b5653-7757-44a3-b1d0-5a7ed512591a tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:39:55.764806 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-da8b5653-7757-44a3-b1d0-5a7ed512591a tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] [instance: 288920f8-c6ff-4a73-a792-1018854830f3] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:39:55.771648 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-da8b5653-7757-44a3-b1d0-5a7ed512591a tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:55.772124 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-da8b5653-7757-44a3-b1d0-5a7ed512591a tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:55.772558 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-da8b5653-7757-44a3-b1d0-5a7ed512591a tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:55.773248 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-da8b5653-7757-44a3-b1d0-5a7ed512591a tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:55.773728 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-da8b5653-7757-44a3-b1d0-5a7ed512591a tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:55.774157 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-da8b5653-7757-44a3-b1d0-5a7ed512591a tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:56.027269 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-da8b5653-7757-44a3-b1d0-5a7ed512591a tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae302ea931a42b5938884e79c2ae381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c6c1e895b5a49009d67f5d7e0ab6058', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:39:56.035355 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-da8b5653-7757-44a3-b1d0-5a7ed512591a tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] 10.222.0.23 "GET /compute/v2.1/servers/288920f8-c6ff-4a73-a792-1018854830f3" status: 200 len: 1508 microversion: 2.1 time: 0.275189 Sep 09 16:39:56.036252 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 486/959] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:39:55 2022] GET /compute/v2.1/servers/288920f8-c6ff-4a73-a792-1018854830f3 => generated 1508 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:39:56.058948 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-777f3c7f-6e50-42f3-8c4e-f5db47e0291a tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a89cb845-f50f-45de-b9de-b1829fecd0db", "device": "/dev/sdb"}} {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:39:56.061531 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-777f3c7f-6e50-42f3-8c4e-f5db47e0291a tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] [instance: 288920f8-c6ff-4a73-a792-1018854830f3] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:39:56.068426 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-777f3c7f-6e50-42f3-8c4e-f5db47e0291a tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:56.068902 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-777f3c7f-6e50-42f3-8c4e-f5db47e0291a tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:56.069332 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-777f3c7f-6e50-42f3-8c4e-f5db47e0291a tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:56.070028 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-777f3c7f-6e50-42f3-8c4e-f5db47e0291a tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:56.070481 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-777f3c7f-6e50-42f3-8c4e-f5db47e0291a tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:56.070967 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-777f3c7f-6e50-42f3-8c4e-f5db47e0291a tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:56.328727 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-777f3c7f-6e50-42f3-8c4e-f5db47e0291a tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] 10.222.0.23 "POST /compute/v2.1/servers/288920f8-c6ff-4a73-a792-1018854830f3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.273566 Sep 09 16:39:56.329968 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 474/960] 10.222.0.23 () {60 vars in 1323 bytes} [Fri Sep 9 16:39:56 2022] POST /compute/v2.1/servers/288920f8-c6ff-4a73-a792-1018854830f3/os-volume_attachments => generated 194 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:39:56.387073 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [req-d1a52056-cf52-4365-b91f-080821343970 req-1f1282c1-611f-4c34-a26c-966d90b76bc7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "667d78d5-e585-4ce5-a240-797cf2202816", "tag": "5d5ee3f8-848f-4ebf-b6d0-9b071a89552e"}]} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:39:56.421056 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell0:SELECT=4 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:39:56.422286 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell0:SELECT=8 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:39:56.424607 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-d1a52056-cf52-4365-b91f-080821343970 req-1f1282c1-611f-4c34-a26c-966d90b76bc7 service nova] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:56.425286 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-d1a52056-cf52-4365-b91f-080821343970 req-1f1282c1-611f-4c34-a26c-966d90b76bc7 service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:56.426029 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-d1a52056-cf52-4365-b91f-080821343970 req-1f1282c1-611f-4c34-a26c-966d90b76bc7 service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:56.440225 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.compute.server_external_events [req-d1a52056-cf52-4365-b91f-080821343970 req-1f1282c1-611f-4c34-a26c-966d90b76bc7 service nova] Creating event network-changed:5d5ee3f8-848f-4ebf-b6d0-9b071a89552e for instance 667d78d5-e585-4ce5-a240-797cf2202816 on hv-cinder-83124 Sep 09 16:39:56.448647 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [req-d1a52056-cf52-4365-b91f-080821343970 req-1f1282c1-611f-4c34-a26c-966d90b76bc7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070934 Sep 09 16:39:56.449740 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 487/961] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Sep 9 16:39:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:39:57.504104 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-f8803ffa-2191-4a20-ba0e-685a455d5388 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-2081141359"}} {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:39:57.504805 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-f8803ffa-2191-4a20-ba0e-685a455d5388 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] [instance: 667d78d5-e585-4ce5-a240-797cf2202816] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:39:57.511722 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f8803ffa-2191-4a20-ba0e-685a455d5388 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:57.512303 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f8803ffa-2191-4a20-ba0e-685a455d5388 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:57.512802 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f8803ffa-2191-4a20-ba0e-685a455d5388 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:57.513585 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f8803ffa-2191-4a20-ba0e-685a455d5388 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:57.514129 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f8803ffa-2191-4a20-ba0e-685a455d5388 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:57.514640 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f8803ffa-2191-4a20-ba0e-685a455d5388 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:57.646345 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.network.security_group_api [None req-f8803ffa-2191-4a20-ba0e-685a455d5388 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Adding security group 56a2ecc4-8a6e-4ba2-ae92-a5ae0df70da1 to port 5d5ee3f8-848f-4ebf-b6d0-9b071a89552e Sep 09 16:39:57.982907 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-f8803ffa-2191-4a20-ba0e-685a455d5388 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] 10.222.0.23 "POST /compute/v2.1/servers/667d78d5-e585-4ce5-a240-797cf2202816/action" status: 202 len: 0 microversion: 2.1 time: 0.484080 Sep 09 16:39:57.983827 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 475/962] 10.222.0.23 () {60 vars in 1278 bytes} [Fri Sep 9 16:39:57 2022] POST /compute/v2.1/servers/667d78d5-e585-4ce5-a240-797cf2202816/action => generated 0 bytes in 486 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 16:39:57.993517 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-def3b426-9452-41de-bcbb-2d7ce65baf1b tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:39:57.994356 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-def3b426-9452-41de-bcbb-2d7ce65baf1b tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] [instance: 667d78d5-e585-4ce5-a240-797cf2202816] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:39:58.002275 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-def3b426-9452-41de-bcbb-2d7ce65baf1b tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:58.003400 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-def3b426-9452-41de-bcbb-2d7ce65baf1b tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:58.003970 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-def3b426-9452-41de-bcbb-2d7ce65baf1b tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:58.005887 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-def3b426-9452-41de-bcbb-2d7ce65baf1b tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:58.008430 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-def3b426-9452-41de-bcbb-2d7ce65baf1b tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:58.009097 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-def3b426-9452-41de-bcbb-2d7ce65baf1b tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:58.172966 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-def3b426-9452-41de-bcbb-2d7ce65baf1b tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86d1ec821814f628879590513702cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5daf9e9245447dac44278ce813b4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:39:58.181882 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-def3b426-9452-41de-bcbb-2d7ce65baf1b tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] 10.222.0.23 "GET /compute/v2.1/servers/667d78d5-e585-4ce5-a240-797cf2202816" status: 200 len: 1759 microversion: 2.1 time: 0.193418 Sep 09 16:39:58.182449 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 488/963] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:39:57 2022] GET /compute/v2.1/servers/667d78d5-e585-4ce5-a240-797cf2202816 => generated 1759 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:39:58.467652 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [req-95ca48d7-d74e-4494-8851-d3700cbb80fa req-be4a290b-352e-4722-8f73-d329e9404263 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "667d78d5-e585-4ce5-a240-797cf2202816", "tag": "5d5ee3f8-848f-4ebf-b6d0-9b071a89552e"}]} {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:39:58.497116 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [req-95ca48d7-d74e-4494-8851-d3700cbb80fa req-be4a290b-352e-4722-8f73-d329e9404263 service nova] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:58.497702 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [req-95ca48d7-d74e-4494-8851-d3700cbb80fa req-be4a290b-352e-4722-8f73-d329e9404263 service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:58.498107 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [req-95ca48d7-d74e-4494-8851-d3700cbb80fa req-be4a290b-352e-4722-8f73-d329e9404263 service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:58.521624 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.compute.server_external_events [req-95ca48d7-d74e-4494-8851-d3700cbb80fa req-be4a290b-352e-4722-8f73-d329e9404263 service nova] Creating event network-changed:5d5ee3f8-848f-4ebf-b6d0-9b071a89552e for instance 667d78d5-e585-4ce5-a240-797cf2202816 on hv-cinder-83124 Sep 09 16:39:58.526520 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [req-95ca48d7-d74e-4494-8851-d3700cbb80fa req-be4a290b-352e-4722-8f73-d329e9404263 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064007 Sep 09 16:39:58.527703 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 476/964] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Sep 9 16:39:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:39:59.686337 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-6d8abc11-6537-400c-a9e5-b813daed1775 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:39:59.688617 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-6d8abc11-6537-400c-a9e5-b813daed1775 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: e20f4f93-c27e-4971-a495-a3498f2611eb] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:39:59.695185 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6d8abc11-6537-400c-a9e5-b813daed1775 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:59.695678 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6d8abc11-6537-400c-a9e5-b813daed1775 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:59.696112 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6d8abc11-6537-400c-a9e5-b813daed1775 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:59.696802 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6d8abc11-6537-400c-a9e5-b813daed1775 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:59.697260 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6d8abc11-6537-400c-a9e5-b813daed1775 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:59.697682 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6d8abc11-6537-400c-a9e5-b813daed1775 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:59.727048 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-6d8abc11-6537-400c-a9e5-b813daed1775 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044804 Sep 09 16:39:59.727593 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 489/965] 10.222.0.23 () {60 vars in 1343 bytes} [Fri Sep 9 16:39:59 2022] GET /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:39:59.800756 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-4ef02c33-e0fe-41df-b5d0-f5e0c995698d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:39:59.801371 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-4ef02c33-e0fe-41df-b5d0-f5e0c995698d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: e20f4f93-c27e-4971-a495-a3498f2611eb] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:39:59.807897 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-4ef02c33-e0fe-41df-b5d0-f5e0c995698d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:59.808379 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-4ef02c33-e0fe-41df-b5d0-f5e0c995698d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:59.808816 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-4ef02c33-e0fe-41df-b5d0-f5e0c995698d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:59.809510 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-4ef02c33-e0fe-41df-b5d0-f5e0c995698d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:59.809969 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-4ef02c33-e0fe-41df-b5d0-f5e0c995698d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:59.810386 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-4ef02c33-e0fe-41df-b5d0-f5e0c995698d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:59.835507 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-4ef02c33-e0fe-41df-b5d0-f5e0c995698d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: e20f4f93-c27e-4971-a495-a3498f2611eb] Going to try to terminate instance {{(pid=127196) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 16:39:59.928219 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-4ef02c33-e0fe-41df-b5d0-f5e0c995698d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "DELETE /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb" status: 204 len: 0 microversion: 2.20 time: 0.131839 Sep 09 16:39:59.928975 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 477/966] 10.222.0.23 () {60 vars in 1280 bytes} [Fri Sep 9 16:39:59 2022] DELETE /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 09 16:39:59.937747 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-1cb1b8de-a047-4ccb-9743-098ce76cf964 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:39:59.938359 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-1cb1b8de-a047-4ccb-9743-098ce76cf964 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: e20f4f93-c27e-4971-a495-a3498f2611eb] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:39:59.944303 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1cb1b8de-a047-4ccb-9743-098ce76cf964 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:59.944783 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1cb1b8de-a047-4ccb-9743-098ce76cf964 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:59.945205 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1cb1b8de-a047-4ccb-9743-098ce76cf964 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:39:59.945891 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1cb1b8de-a047-4ccb-9743-098ce76cf964 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:39:59.946329 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1cb1b8de-a047-4ccb-9743-098ce76cf964 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:39:59.946769 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1cb1b8de-a047-4ccb-9743-098ce76cf964 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:40:00.080261 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-1cb1b8de-a047-4ccb-9743-098ce76cf964 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:40:00.090808 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-1cb1b8de-a047-4ccb-9743-098ce76cf964 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:40:00.092628 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-1cb1b8de-a047-4ccb-9743-098ce76cf964 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:40:00.094138 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-1cb1b8de-a047-4ccb-9743-098ce76cf964 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb" status: 200 len: 1721 microversion: 2.20 time: 0.160603 Sep 09 16:40:00.094727 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 490/967] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Sep 9 16:39:59 2022] GET /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 16:40:01.119734 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-d9ade0aa-9ff8-4eb0-8620-b0827504974f tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:40:01.120465 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-d9ade0aa-9ff8-4eb0-8620-b0827504974f tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: e20f4f93-c27e-4971-a495-a3498f2611eb] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:40:01.127320 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-d9ade0aa-9ff8-4eb0-8620-b0827504974f tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:40:01.127803 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-d9ade0aa-9ff8-4eb0-8620-b0827504974f tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:40:01.128224 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-d9ade0aa-9ff8-4eb0-8620-b0827504974f tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:40:01.128925 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-d9ade0aa-9ff8-4eb0-8620-b0827504974f tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:40:01.129374 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-d9ade0aa-9ff8-4eb0-8620-b0827504974f tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:40:01.129797 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-d9ade0aa-9ff8-4eb0-8620-b0827504974f tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:40:01.290180 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-d9ade0aa-9ff8-4eb0-8620-b0827504974f tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:40:01.298803 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-d9ade0aa-9ff8-4eb0-8620-b0827504974f tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:40:01.300409 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-d9ade0aa-9ff8-4eb0-8620-b0827504974f tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:40:01.301581 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-d9ade0aa-9ff8-4eb0-8620-b0827504974f tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb" status: 200 len: 1721 microversion: 2.20 time: 0.186296 Sep 09 16:40:01.302144 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 478/968] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Sep 9 16:40:01 2022] GET /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb => generated 1721 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 16:40:02.327911 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-800e384d-c856-4616-91bd-7b86c1b47756 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:40:02.328541 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-800e384d-c856-4616-91bd-7b86c1b47756 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: e20f4f93-c27e-4971-a495-a3498f2611eb] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:40:02.335811 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-800e384d-c856-4616-91bd-7b86c1b47756 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:40:02.336299 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-800e384d-c856-4616-91bd-7b86c1b47756 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:40:02.336731 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-800e384d-c856-4616-91bd-7b86c1b47756 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:40:02.337428 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-800e384d-c856-4616-91bd-7b86c1b47756 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:40:02.337879 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-800e384d-c856-4616-91bd-7b86c1b47756 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:40:02.338294 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-800e384d-c856-4616-91bd-7b86c1b47756 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:40:02.411766 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-800e384d-c856-4616-91bd-7b86c1b47756 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:40:02.423640 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-800e384d-c856-4616-91bd-7b86c1b47756 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:40:02.426121 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-800e384d-c856-4616-91bd-7b86c1b47756 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8bd900e231242c3ae67432d26d089da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fca9208950f4d1a92bd52b4e5f5b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:40:02.427692 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-800e384d-c856-4616-91bd-7b86c1b47756 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb" status: 200 len: 1654 microversion: 2.20 time: 0.103687 Sep 09 16:40:02.442662 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 491/969] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Sep 9 16:40:02 2022] GET /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb => generated 1654 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 16:40:02.462846 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [req-7eb01f7d-b05d-4819-b5be-d5e3fbba63b5 req-87713c12-d890-42e3-865f-2651b10af293 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e20f4f93-c27e-4971-a495-a3498f2611eb", "name": "network-vif-deleted", "tag": "8bab0b25-2131-47ef-88e3-210f0d9e7556"}]} {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:40:02.475178 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [req-7eb01f7d-b05d-4819-b5be-d5e3fbba63b5 req-87713c12-d890-42e3-865f-2651b10af293 service nova] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:40:02.475687 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [req-7eb01f7d-b05d-4819-b5be-d5e3fbba63b5 req-87713c12-d890-42e3-865f-2651b10af293 service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:40:02.476298 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [req-7eb01f7d-b05d-4819-b5be-d5e3fbba63b5 req-87713c12-d890-42e3-865f-2651b10af293 service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:40:02.490984 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.compute.server_external_events [req-7eb01f7d-b05d-4819-b5be-d5e3fbba63b5 req-87713c12-d890-42e3-865f-2651b10af293 service nova] Creating event network-vif-deleted:8bab0b25-2131-47ef-88e3-210f0d9e7556 for instance e20f4f93-c27e-4971-a495-a3498f2611eb on hv-cinder-83124 Sep 09 16:40:02.496518 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [req-7eb01f7d-b05d-4819-b5be-d5e3fbba63b5 req-87713c12-d890-42e3-865f-2651b10af293 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038035 Sep 09 16:40:02.497795 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 479/970] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Sep 9 16:40:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:40:03.456311 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-ca36cf06-c906-4517-ba54-3784ec036c5f tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:40:03.457675 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-ca36cf06-c906-4517-ba54-3784ec036c5f tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: e20f4f93-c27e-4971-a495-a3498f2611eb] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:40:03.465018 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ca36cf06-c906-4517-ba54-3784ec036c5f tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:40:03.465586 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ca36cf06-c906-4517-ba54-3784ec036c5f tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:40:03.466049 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ca36cf06-c906-4517-ba54-3784ec036c5f tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:40:03.466991 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ca36cf06-c906-4517-ba54-3784ec036c5f tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:40:03.467613 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ca36cf06-c906-4517-ba54-3784ec036c5f tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:40:03.468290 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ca36cf06-c906-4517-ba54-3784ec036c5f tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:40:03.484493 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.wsgi [None req-ca36cf06-c906-4517-ba54-3784ec036c5f tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] HTTP exception thrown: Instance e20f4f93-c27e-4971-a495-a3498f2611eb could not be found. Sep 09 16:40:03.486256 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-ca36cf06-c906-4517-ba54-3784ec036c5f tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Request method failure captured: Sep 09 16:40:03.486256 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: request: GET /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb HTTP/1.1 Sep 09 16:40:03.486256 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Accept: application/json Sep 09 16:40:03.486256 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Accept-Encoding: identity Sep 09 16:40:03.486256 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Connection: close Sep 09 16:40:03.486256 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Content-Length: 0 Sep 09 16:40:03.486256 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Content-Type: application/json Sep 09 16:40:03.486256 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Host: 10.222.0.23 Sep 09 16:40:03.486256 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Openstack-System-Scope: None Sep 09 16:40:03.486256 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: User-Agent: python-urllib3/1.26.12 Sep 09 16:40:03.486256 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Auth-Token: gAAAAABjG2raKYeiSpbkPQNbV7fWt1cZR_8Twt55ecqE0w84KGgvpJskbtFih0XPKN4NfFMBp4ICDdrG6hYAZbjgPreFya4ru2WM3cAXbDaI2xKcVwIS7rE8NZFGdJ2dTo6h1U2haccU7HXgJ_zTmaKPUi9_WJQQdTThBPEpEt3WrJzqpXhxNbs Sep 09 16:40:03.486256 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Domain-Id: None Sep 09 16:40:03.486256 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Domain-Name: None Sep 09 16:40:03.486256 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Identity-Status: Confirmed Sep 09 16:40:03.486256 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Is-Admin-Project: True Sep 09 16:40:03.486256 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Openstack-Nova-Api-Version: 2.20 Sep 09 16:40:03.486256 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Project-Domain-Id: default Sep 09 16:40:03.486256 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Project-Domain-Name: Default Sep 09 16:40:03.486256 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Project-Id: 3fca9208950f4d1a92bd52b4e5f5b2a1 Sep 09 16:40:03.486256 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1737157302 Sep 09 16:40:03.486256 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Role: member,reader Sep 09 16:40:03.486256 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Roles: member,reader Sep 09 16:40:03.487931 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3fca9208950f4d1a92bd52b4e5f5b2a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3fca9208950f4d1a92bd52b4e5f5b2a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3fca9208950f4d1a92bd52b4e5f5b2a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3fca9208950f4d1a92bd52b4e5f5b2a1"}]}] Sep 09 16:40:03.487931 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1737157302 Sep 09 16:40:03.487931 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Tenant-Id: 3fca9208950f4d1a92bd52b4e5f5b2a1 Sep 09 16:40:03.487931 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1737157302 Sep 09 16:40:03.487931 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User: tempest-AttachVolumeShelveTestJSON-1737157302-project Sep 09 16:40:03.487931 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User-Domain-Id: default Sep 09 16:40:03.487931 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User-Domain-Name: Default Sep 09 16:40:03.487931 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User-Id: f8bd900e231242c3ae67432d26d089da Sep 09 16:40:03.487931 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1737157302-project Sep 09 16:40:03.487931 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: method: > Sep 09 16:40:03.487931 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: exception: Instance e20f4f93-c27e-4971-a495-a3498f2611eb could not be found. Sep 09 16:40:03.487931 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: action_args: {'id': 'e20f4f93-c27e-4971-a495-a3498f2611eb'} Sep 09 16:40:03.489449 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 16:40:03.489449 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:40:03.489449 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 16:40:03.489449 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 16:40:03.489449 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 16:40:03.489449 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 16:40:03.489449 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 16:40:03.489449 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 16:40:03.489449 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 16:40:03.489449 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 16:40:03.489449 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e20f4f93-c27e-4971-a495-a3498f2611eb could not be found. Sep 09 16:40:03.489449 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:40:03.489449 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 16:40:03.489449 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:40:03.489449 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:40:03.489449 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 16:40:03.489449 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 16:40:03.489449 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 16:40:03.489449 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 16:40:03.489449 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 16:40:03.491663 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 16:40:03.491663 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 16:40:03.491663 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 16:40:03.491663 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 16:40:03.491663 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 16:40:03.491663 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 16:40:03.491663 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 16:40:03.491663 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e20f4f93-c27e-4971-a495-a3498f2611eb could not be found. Sep 09 16:40:03.491663 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:40:03.491663 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 16:40:03.491663 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:40:03.491663 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:40:03.491663 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 16:40:03.491663 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 16:40:03.491663 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 16:40:03.491663 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 16:40:03.491663 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e20f4f93-c27e-4971-a495-a3498f2611eb could not be found. Sep 09 16:40:03.491663 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:40:03.494002 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-ca36cf06-c906-4517-ba54-3784ec036c5f tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Returning 404 to user: Instance e20f4f93-c27e-4971-a495-a3498f2611eb could not be found. {{(pid=127198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 16:40:03.494002 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-ca36cf06-c906-4517-ba54-3784ec036c5f tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb" status: 404 len: 111 microversion: 2.20 time: 0.035685 Sep 09 16:40:03.494002 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 492/971] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Sep 9 16:40:03 2022] GET /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 09 16:40:03.498188 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-4a4713a7-058d-4b37-b010-d67921b2029f tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '.version_select at 0x7f24fb6205e0>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:40:03.518390 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-4a4713a7-058d-4b37-b010-d67921b2029f tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-766971705" status: 204 len: 0 microversion: 2.20 time: 0.024832 Sep 09 16:40:03.518994 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 480/972] 10.222.0.23 () {60 vars in 1259 bytes} [Fri Sep 9 16:40:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-766971705 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 09 16:40:08.493200 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-db14837f-da29-488c-a9c0-4472503eeb9d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:40:08.493710 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-db14837f-da29-488c-a9c0-4472503eeb9d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: e20f4f93-c27e-4971-a495-a3498f2611eb] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:40:08.500782 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-db14837f-da29-488c-a9c0-4472503eeb9d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:40:08.501290 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-db14837f-da29-488c-a9c0-4472503eeb9d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:40:08.501721 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-db14837f-da29-488c-a9c0-4472503eeb9d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:40:08.502387 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-db14837f-da29-488c-a9c0-4472503eeb9d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:40:08.502878 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-db14837f-da29-488c-a9c0-4472503eeb9d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:40:08.503310 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-db14837f-da29-488c-a9c0-4472503eeb9d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:40:08.517067 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.wsgi [None req-db14837f-da29-488c-a9c0-4472503eeb9d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] HTTP exception thrown: Instance e20f4f93-c27e-4971-a495-a3498f2611eb could not be found. Sep 09 16:40:08.518645 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-db14837f-da29-488c-a9c0-4472503eeb9d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Request method failure captured: Sep 09 16:40:08.518645 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: request: DELETE /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb HTTP/1.1 Sep 09 16:40:08.518645 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Accept: application/json Sep 09 16:40:08.518645 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Accept-Encoding: identity Sep 09 16:40:08.518645 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Connection: close Sep 09 16:40:08.518645 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Content-Length: 0 Sep 09 16:40:08.518645 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Content-Type: application/json Sep 09 16:40:08.518645 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Host: 10.222.0.23 Sep 09 16:40:08.518645 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Openstack-System-Scope: None Sep 09 16:40:08.518645 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: User-Agent: python-urllib3/1.26.12 Sep 09 16:40:08.518645 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Auth-Token: gAAAAABjG2raKYeiSpbkPQNbV7fWt1cZR_8Twt55ecqE0w84KGgvpJskbtFih0XPKN4NfFMBp4ICDdrG6hYAZbjgPreFya4ru2WM3cAXbDaI2xKcVwIS7rE8NZFGdJ2dTo6h1U2haccU7HXgJ_zTmaKPUi9_WJQQdTThBPEpEt3WrJzqpXhxNbs Sep 09 16:40:08.518645 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Domain-Id: None Sep 09 16:40:08.518645 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Domain-Name: None Sep 09 16:40:08.518645 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Identity-Status: Confirmed Sep 09 16:40:08.518645 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Is-Admin-Project: True Sep 09 16:40:08.518645 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Openstack-Nova-Api-Version: 2.20 Sep 09 16:40:08.518645 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Project-Domain-Id: default Sep 09 16:40:08.518645 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Project-Domain-Name: Default Sep 09 16:40:08.518645 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Project-Id: 3fca9208950f4d1a92bd52b4e5f5b2a1 Sep 09 16:40:08.518645 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1737157302 Sep 09 16:40:08.518645 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Role: member,reader Sep 09 16:40:08.518645 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Roles: member,reader Sep 09 16:40:08.520489 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3fca9208950f4d1a92bd52b4e5f5b2a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3fca9208950f4d1a92bd52b4e5f5b2a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3fca9208950f4d1a92bd52b4e5f5b2a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3fca9208950f4d1a92bd52b4e5f5b2a1"}]}] Sep 09 16:40:08.520489 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1737157302 Sep 09 16:40:08.520489 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Tenant-Id: 3fca9208950f4d1a92bd52b4e5f5b2a1 Sep 09 16:40:08.520489 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1737157302 Sep 09 16:40:08.520489 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User: tempest-AttachVolumeShelveTestJSON-1737157302-project Sep 09 16:40:08.520489 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User-Domain-Id: default Sep 09 16:40:08.520489 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User-Domain-Name: Default Sep 09 16:40:08.520489 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User-Id: f8bd900e231242c3ae67432d26d089da Sep 09 16:40:08.520489 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1737157302-project Sep 09 16:40:08.520489 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: method: > Sep 09 16:40:08.520489 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: exception: Instance e20f4f93-c27e-4971-a495-a3498f2611eb could not be found. Sep 09 16:40:08.520489 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: action_args: {'id': 'e20f4f93-c27e-4971-a495-a3498f2611eb'} Sep 09 16:40:08.521459 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 16:40:08.521459 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:40:08.521459 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 16:40:08.521459 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 16:40:08.521459 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 16:40:08.521459 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 16:40:08.521459 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 16:40:08.521459 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 16:40:08.521459 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 16:40:08.521459 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 16:40:08.521459 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e20f4f93-c27e-4971-a495-a3498f2611eb could not be found. Sep 09 16:40:08.521459 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:40:08.521459 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 16:40:08.521459 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:40:08.521459 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:40:08.521459 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 16:40:08.521459 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 16:40:08.521459 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 16:40:08.521459 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 16:40:08.521459 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 16:40:08.522979 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 16:40:08.522979 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 09 16:40:08.522979 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 09 16:40:08.522979 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 09 16:40:08.522979 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 09 16:40:08.522979 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 16:40:08.522979 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 16:40:08.522979 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 16:40:08.522979 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 16:40:08.522979 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e20f4f93-c27e-4971-a495-a3498f2611eb could not be found. Sep 09 16:40:08.522979 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:40:08.522979 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 16:40:08.522979 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:40:08.522979 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:40:08.522979 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 16:40:08.522979 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 16:40:08.522979 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 16:40:08.522979 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 16:40:08.522979 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e20f4f93-c27e-4971-a495-a3498f2611eb could not be found. Sep 09 16:40:08.522979 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:40:08.524706 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-db14837f-da29-488c-a9c0-4472503eeb9d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Returning 404 to user: Instance e20f4f93-c27e-4971-a495-a3498f2611eb could not be found. {{(pid=127198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 16:40:08.524706 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-db14837f-da29-488c-a9c0-4472503eeb9d tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "DELETE /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb" status: 404 len: 111 microversion: 2.20 time: 0.031002 Sep 09 16:40:08.524706 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 493/973] 10.222.0.23 () {60 vars in 1280 bytes} [Fri Sep 9 16:40:08 2022] DELETE /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 09 16:40:08.528760 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-7d53d06e-c1e0-428f-9df7-e72881b7bfaa tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:40:08.529524 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-7d53d06e-c1e0-428f-9df7-e72881b7bfaa tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: e20f4f93-c27e-4971-a495-a3498f2611eb] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:40:08.532545 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG dbcounter [-] [127196] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:40:08.539997 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-7d53d06e-c1e0-428f-9df7-e72881b7bfaa tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:40:08.540919 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-7d53d06e-c1e0-428f-9df7-e72881b7bfaa tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:40:08.541476 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-7d53d06e-c1e0-428f-9df7-e72881b7bfaa tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:40:08.542190 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-7d53d06e-c1e0-428f-9df7-e72881b7bfaa tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:40:08.542678 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-7d53d06e-c1e0-428f-9df7-e72881b7bfaa tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:40:08.543128 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-7d53d06e-c1e0-428f-9df7-e72881b7bfaa tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:40:08.558798 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.wsgi [None req-7d53d06e-c1e0-428f-9df7-e72881b7bfaa tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] HTTP exception thrown: Instance e20f4f93-c27e-4971-a495-a3498f2611eb could not be found. Sep 09 16:40:08.561371 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-7d53d06e-c1e0-428f-9df7-e72881b7bfaa tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Request method failure captured: Sep 09 16:40:08.561371 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: request: GET /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb HTTP/1.1 Sep 09 16:40:08.561371 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Accept: application/json Sep 09 16:40:08.561371 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Accept-Encoding: identity Sep 09 16:40:08.561371 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Connection: close Sep 09 16:40:08.561371 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Content-Length: 0 Sep 09 16:40:08.561371 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Content-Type: application/json Sep 09 16:40:08.561371 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Host: 10.222.0.23 Sep 09 16:40:08.561371 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Openstack-System-Scope: None Sep 09 16:40:08.561371 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: User-Agent: python-urllib3/1.26.12 Sep 09 16:40:08.561371 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Auth-Token: gAAAAABjG2raKYeiSpbkPQNbV7fWt1cZR_8Twt55ecqE0w84KGgvpJskbtFih0XPKN4NfFMBp4ICDdrG6hYAZbjgPreFya4ru2WM3cAXbDaI2xKcVwIS7rE8NZFGdJ2dTo6h1U2haccU7HXgJ_zTmaKPUi9_WJQQdTThBPEpEt3WrJzqpXhxNbs Sep 09 16:40:08.561371 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Domain-Id: None Sep 09 16:40:08.561371 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Domain-Name: None Sep 09 16:40:08.561371 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Identity-Status: Confirmed Sep 09 16:40:08.561371 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Is-Admin-Project: True Sep 09 16:40:08.561371 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Openstack-Nova-Api-Version: 2.20 Sep 09 16:40:08.561371 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Project-Domain-Id: default Sep 09 16:40:08.561371 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Project-Domain-Name: Default Sep 09 16:40:08.561371 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Project-Id: 3fca9208950f4d1a92bd52b4e5f5b2a1 Sep 09 16:40:08.561371 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1737157302 Sep 09 16:40:08.561371 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Role: member,reader Sep 09 16:40:08.561371 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Roles: member,reader Sep 09 16:40:08.563206 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3fca9208950f4d1a92bd52b4e5f5b2a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3fca9208950f4d1a92bd52b4e5f5b2a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3fca9208950f4d1a92bd52b4e5f5b2a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3fca9208950f4d1a92bd52b4e5f5b2a1"}]}] Sep 09 16:40:08.563206 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1737157302 Sep 09 16:40:08.563206 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Tenant-Id: 3fca9208950f4d1a92bd52b4e5f5b2a1 Sep 09 16:40:08.563206 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1737157302 Sep 09 16:40:08.563206 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-User: tempest-AttachVolumeShelveTestJSON-1737157302-project Sep 09 16:40:08.563206 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-User-Domain-Id: default Sep 09 16:40:08.563206 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-User-Domain-Name: Default Sep 09 16:40:08.563206 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-User-Id: f8bd900e231242c3ae67432d26d089da Sep 09 16:40:08.563206 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1737157302-project Sep 09 16:40:08.563206 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: method: > Sep 09 16:40:08.563206 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: exception: Instance e20f4f93-c27e-4971-a495-a3498f2611eb could not be found. Sep 09 16:40:08.563206 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: action_args: {'id': 'e20f4f93-c27e-4971-a495-a3498f2611eb'} Sep 09 16:40:08.564101 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 16:40:08.564101 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:40:08.564101 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 16:40:08.564101 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 16:40:08.564101 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 16:40:08.564101 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 16:40:08.564101 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 16:40:08.564101 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 16:40:08.564101 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 16:40:08.564101 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 16:40:08.564101 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e20f4f93-c27e-4971-a495-a3498f2611eb could not be found. Sep 09 16:40:08.564101 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Sep 09 16:40:08.564101 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 16:40:08.564101 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Sep 09 16:40:08.564101 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:40:08.564101 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 16:40:08.564101 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 16:40:08.564101 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 16:40:08.564101 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 16:40:08.564101 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 16:40:08.565619 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 16:40:08.565619 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 16:40:08.565619 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 16:40:08.565619 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 16:40:08.565619 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 16:40:08.565619 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 16:40:08.565619 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 16:40:08.565619 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e20f4f93-c27e-4971-a495-a3498f2611eb could not be found. Sep 09 16:40:08.565619 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Sep 09 16:40:08.565619 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 16:40:08.565619 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Sep 09 16:40:08.565619 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:40:08.565619 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 16:40:08.565619 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 16:40:08.565619 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 16:40:08.565619 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 16:40:08.565619 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e20f4f93-c27e-4971-a495-a3498f2611eb could not be found. Sep 09 16:40:08.565619 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Sep 09 16:40:08.566757 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-7d53d06e-c1e0-428f-9df7-e72881b7bfaa tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Returning 404 to user: Instance e20f4f93-c27e-4971-a495-a3498f2611eb could not be found. {{(pid=127196) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 16:40:08.566757 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-7d53d06e-c1e0-428f-9df7-e72881b7bfaa tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb" status: 404 len: 111 microversion: 2.20 time: 0.038414 Sep 09 16:40:08.566757 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 481/974] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Sep 9 16:40:08 2022] GET /compute/v2.1/servers/e20f4f93-c27e-4971-a495-a3498f2611eb => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 09 16:40:11.836610 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-46c43e73-b89d-4612-9585-543fbc483170 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:40:11.837093 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-46c43e73-b89d-4612-9585-543fbc483170 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: 27b503a6-c023-49fb-b11a-37da810939cf] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:40:11.844004 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-46c43e73-b89d-4612-9585-543fbc483170 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:40:11.844481 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-46c43e73-b89d-4612-9585-543fbc483170 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:40:11.844909 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-46c43e73-b89d-4612-9585-543fbc483170 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:40:11.845598 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-46c43e73-b89d-4612-9585-543fbc483170 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:40:11.846049 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-46c43e73-b89d-4612-9585-543fbc483170 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:40:11.846470 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-46c43e73-b89d-4612-9585-543fbc483170 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:40:11.862034 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.wsgi [None req-46c43e73-b89d-4612-9585-543fbc483170 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] HTTP exception thrown: Instance 27b503a6-c023-49fb-b11a-37da810939cf could not be found. Sep 09 16:40:11.863668 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-46c43e73-b89d-4612-9585-543fbc483170 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Request method failure captured: Sep 09 16:40:11.863668 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: request: DELETE /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf HTTP/1.1 Sep 09 16:40:11.863668 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Accept: application/json Sep 09 16:40:11.863668 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Accept-Encoding: identity Sep 09 16:40:11.863668 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Connection: close Sep 09 16:40:11.863668 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Content-Length: 0 Sep 09 16:40:11.863668 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Content-Type: application/json Sep 09 16:40:11.863668 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Host: 10.222.0.23 Sep 09 16:40:11.863668 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Openstack-System-Scope: None Sep 09 16:40:11.863668 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: User-Agent: python-urllib3/1.26.12 Sep 09 16:40:11.863668 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Auth-Token: gAAAAABjG2raKYeiSpbkPQNbV7fWt1cZR_8Twt55ecqE0w84KGgvpJskbtFih0XPKN4NfFMBp4ICDdrG6hYAZbjgPreFya4ru2WM3cAXbDaI2xKcVwIS7rE8NZFGdJ2dTo6h1U2haccU7HXgJ_zTmaKPUi9_WJQQdTThBPEpEt3WrJzqpXhxNbs Sep 09 16:40:11.863668 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Domain-Id: None Sep 09 16:40:11.863668 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Domain-Name: None Sep 09 16:40:11.863668 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Identity-Status: Confirmed Sep 09 16:40:11.863668 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Is-Admin-Project: True Sep 09 16:40:11.863668 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Openstack-Nova-Api-Version: 2.20 Sep 09 16:40:11.863668 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Project-Domain-Id: default Sep 09 16:40:11.863668 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Project-Domain-Name: Default Sep 09 16:40:11.863668 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Project-Id: 3fca9208950f4d1a92bd52b4e5f5b2a1 Sep 09 16:40:11.863668 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1737157302 Sep 09 16:40:11.863668 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Role: member,reader Sep 09 16:40:11.863668 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Roles: member,reader Sep 09 16:40:11.865300 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3fca9208950f4d1a92bd52b4e5f5b2a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3fca9208950f4d1a92bd52b4e5f5b2a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3fca9208950f4d1a92bd52b4e5f5b2a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3fca9208950f4d1a92bd52b4e5f5b2a1"}]}] Sep 09 16:40:11.865300 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1737157302 Sep 09 16:40:11.865300 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Tenant-Id: 3fca9208950f4d1a92bd52b4e5f5b2a1 Sep 09 16:40:11.865300 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1737157302 Sep 09 16:40:11.865300 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User: tempest-AttachVolumeShelveTestJSON-1737157302-project Sep 09 16:40:11.865300 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User-Domain-Id: default Sep 09 16:40:11.865300 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User-Domain-Name: Default Sep 09 16:40:11.865300 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User-Id: f8bd900e231242c3ae67432d26d089da Sep 09 16:40:11.865300 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1737157302-project Sep 09 16:40:11.865300 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: method: > Sep 09 16:40:11.865300 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: exception: Instance 27b503a6-c023-49fb-b11a-37da810939cf could not be found. Sep 09 16:40:11.865300 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: action_args: {'id': '27b503a6-c023-49fb-b11a-37da810939cf'} Sep 09 16:40:11.866186 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 16:40:11.866186 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:40:11.866186 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 16:40:11.866186 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 16:40:11.866186 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 16:40:11.866186 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 16:40:11.866186 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 16:40:11.866186 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 16:40:11.866186 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 16:40:11.866186 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 16:40:11.866186 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27b503a6-c023-49fb-b11a-37da810939cf could not be found. Sep 09 16:40:11.866186 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:40:11.866186 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 16:40:11.866186 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:40:11.866186 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:40:11.866186 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 16:40:11.866186 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 16:40:11.866186 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 16:40:11.866186 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 16:40:11.866186 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 16:40:11.867721 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 16:40:11.867721 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 09 16:40:11.867721 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 09 16:40:11.867721 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 09 16:40:11.867721 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 09 16:40:11.867721 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 16:40:11.867721 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 16:40:11.867721 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 16:40:11.867721 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 16:40:11.867721 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27b503a6-c023-49fb-b11a-37da810939cf could not be found. Sep 09 16:40:11.867721 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:40:11.867721 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 16:40:11.867721 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:40:11.867721 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:40:11.867721 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 16:40:11.867721 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 16:40:11.867721 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 16:40:11.867721 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 16:40:11.867721 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27b503a6-c023-49fb-b11a-37da810939cf could not be found. Sep 09 16:40:11.867721 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:40:11.869205 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-46c43e73-b89d-4612-9585-543fbc483170 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Returning 404 to user: Instance 27b503a6-c023-49fb-b11a-37da810939cf could not be found. {{(pid=127198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 16:40:11.869205 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-46c43e73-b89d-4612-9585-543fbc483170 tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "DELETE /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf" status: 404 len: 111 microversion: 2.20 time: 0.032408 Sep 09 16:40:11.869205 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 494/975] 10.222.0.23 () {60 vars in 1280 bytes} [Fri Sep 9 16:40:11 2022] DELETE /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 09 16:40:11.873595 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-191cd331-350c-46ae-a409-77029c4e772c tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:40:11.874207 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-191cd331-350c-46ae-a409-77029c4e772c tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] [instance: 27b503a6-c023-49fb-b11a-37da810939cf] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:40:11.881063 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-191cd331-350c-46ae-a409-77029c4e772c tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:40:11.881632 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-191cd331-350c-46ae-a409-77029c4e772c tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:40:11.882062 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-191cd331-350c-46ae-a409-77029c4e772c tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:40:11.882777 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-191cd331-350c-46ae-a409-77029c4e772c tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:40:11.883221 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-191cd331-350c-46ae-a409-77029c4e772c tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:40:11.883634 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-191cd331-350c-46ae-a409-77029c4e772c tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:40:11.897259 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.wsgi [None req-191cd331-350c-46ae-a409-77029c4e772c tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] HTTP exception thrown: Instance 27b503a6-c023-49fb-b11a-37da810939cf could not be found. Sep 09 16:40:11.898815 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-191cd331-350c-46ae-a409-77029c4e772c tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Request method failure captured: Sep 09 16:40:11.898815 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: request: GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf HTTP/1.1 Sep 09 16:40:11.898815 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Accept: application/json Sep 09 16:40:11.898815 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Accept-Encoding: identity Sep 09 16:40:11.898815 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Connection: close Sep 09 16:40:11.898815 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Content-Length: 0 Sep 09 16:40:11.898815 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Content-Type: application/json Sep 09 16:40:11.898815 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Host: 10.222.0.23 Sep 09 16:40:11.898815 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Openstack-System-Scope: None Sep 09 16:40:11.898815 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: User-Agent: python-urllib3/1.26.12 Sep 09 16:40:11.898815 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Auth-Token: gAAAAABjG2raKYeiSpbkPQNbV7fWt1cZR_8Twt55ecqE0w84KGgvpJskbtFih0XPKN4NfFMBp4ICDdrG6hYAZbjgPreFya4ru2WM3cAXbDaI2xKcVwIS7rE8NZFGdJ2dTo6h1U2haccU7HXgJ_zTmaKPUi9_WJQQdTThBPEpEt3WrJzqpXhxNbs Sep 09 16:40:11.898815 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Domain-Id: None Sep 09 16:40:11.898815 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Domain-Name: None Sep 09 16:40:11.898815 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Identity-Status: Confirmed Sep 09 16:40:11.898815 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Is-Admin-Project: True Sep 09 16:40:11.898815 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Openstack-Nova-Api-Version: 2.20 Sep 09 16:40:11.898815 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Project-Domain-Id: default Sep 09 16:40:11.898815 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Project-Domain-Name: Default Sep 09 16:40:11.898815 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Project-Id: 3fca9208950f4d1a92bd52b4e5f5b2a1 Sep 09 16:40:11.898815 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1737157302 Sep 09 16:40:11.898815 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Role: member,reader Sep 09 16:40:11.898815 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Roles: member,reader Sep 09 16:40:11.900499 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3fca9208950f4d1a92bd52b4e5f5b2a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3fca9208950f4d1a92bd52b4e5f5b2a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3fca9208950f4d1a92bd52b4e5f5b2a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3fca9208950f4d1a92bd52b4e5f5b2a1"}]}] Sep 09 16:40:11.900499 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1737157302 Sep 09 16:40:11.900499 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Tenant-Id: 3fca9208950f4d1a92bd52b4e5f5b2a1 Sep 09 16:40:11.900499 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1737157302 Sep 09 16:40:11.900499 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-User: tempest-AttachVolumeShelveTestJSON-1737157302-project Sep 09 16:40:11.900499 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-User-Domain-Id: default Sep 09 16:40:11.900499 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-User-Domain-Name: Default Sep 09 16:40:11.900499 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-User-Id: f8bd900e231242c3ae67432d26d089da Sep 09 16:40:11.900499 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1737157302-project Sep 09 16:40:11.900499 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: method: > Sep 09 16:40:11.900499 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: exception: Instance 27b503a6-c023-49fb-b11a-37da810939cf could not be found. Sep 09 16:40:11.900499 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: action_args: {'id': '27b503a6-c023-49fb-b11a-37da810939cf'} Sep 09 16:40:11.901400 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 16:40:11.901400 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:40:11.901400 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 16:40:11.901400 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 16:40:11.901400 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 16:40:11.901400 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 16:40:11.901400 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 16:40:11.901400 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 16:40:11.901400 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 16:40:11.901400 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 16:40:11.901400 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27b503a6-c023-49fb-b11a-37da810939cf could not be found. Sep 09 16:40:11.901400 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Sep 09 16:40:11.901400 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 16:40:11.901400 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Sep 09 16:40:11.901400 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:40:11.901400 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 16:40:11.901400 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 16:40:11.901400 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 16:40:11.901400 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 16:40:11.901400 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 16:40:11.902869 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 16:40:11.902869 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 16:40:11.902869 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 16:40:11.902869 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 16:40:11.902869 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 16:40:11.902869 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 16:40:11.902869 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 16:40:11.902869 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27b503a6-c023-49fb-b11a-37da810939cf could not be found. Sep 09 16:40:11.902869 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Sep 09 16:40:11.902869 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 16:40:11.902869 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Sep 09 16:40:11.902869 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:40:11.902869 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 16:40:11.902869 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 16:40:11.902869 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 16:40:11.902869 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 16:40:11.902869 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27b503a6-c023-49fb-b11a-37da810939cf could not be found. Sep 09 16:40:11.902869 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Sep 09 16:40:11.904182 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-191cd331-350c-46ae-a409-77029c4e772c tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] Returning 404 to user: Instance 27b503a6-c023-49fb-b11a-37da810939cf could not be found. {{(pid=127196) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 16:40:11.904182 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-191cd331-350c-46ae-a409-77029c4e772c tempest-AttachVolumeShelveTestJSON-1737157302 tempest-AttachVolumeShelveTestJSON-1737157302-project] 10.222.0.23 "GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf" status: 404 len: 111 microversion: 2.20 time: 0.030541 Sep 09 16:40:11.904182 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 482/976] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Sep 9 16:40:11 2022] GET /compute/v2.1/servers/27b503a6-c023-49fb-b11a-37da810939cf => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 09 16:40:14.860137 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-b35459fa-a7b5-45d8-a02a-64466d9fecae tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:40:14.860698 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-b35459fa-a7b5-45d8-a02a-64466d9fecae tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] [instance: 288920f8-c6ff-4a73-a792-1018854830f3] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:40:14.869359 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b35459fa-a7b5-45d8-a02a-64466d9fecae tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:40:14.869359 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b35459fa-a7b5-45d8-a02a-64466d9fecae tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:40:14.869359 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b35459fa-a7b5-45d8-a02a-64466d9fecae tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:40:14.869359 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b35459fa-a7b5-45d8-a02a-64466d9fecae tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:40:14.869972 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b35459fa-a7b5-45d8-a02a-64466d9fecae tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:40:14.870681 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b35459fa-a7b5-45d8-a02a-64466d9fecae tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:40:14.991917 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.objects.instance [None req-b35459fa-a7b5-45d8-a02a-64466d9fecae tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Lazy-loading 'services' on Instance uuid 288920f8-c6ff-4a73-a792-1018854830f3 {{(pid=127198) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 16:40:15.087680 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-b35459fa-a7b5-45d8-a02a-64466d9fecae tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] 10.222.0.23 "DELETE /compute/v2.1/servers/288920f8-c6ff-4a73-a792-1018854830f3/os-volume_attachments/a89cb845-f50f-45de-b9de-b1829fecd0db" status: 202 len: 0 microversion: 2.1 time: 0.231472 Sep 09 16:40:15.088470 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 495/977] 10.222.0.23 () {58 vars in 1416 bytes} [Fri Sep 9 16:40:14 2022] DELETE /compute/v2.1/servers/288920f8-c6ff-4a73-a792-1018854830f3/os-volume_attachments/a89cb845-f50f-45de-b9de-b1829fecd0db => generated 0 bytes in 233 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 16:40:16.243025 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-59714cce-69d0-415f-8a4f-64e4fa18f92f tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:40:16.243528 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-59714cce-69d0-415f-8a4f-64e4fa18f92f tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] [instance: 288920f8-c6ff-4a73-a792-1018854830f3] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:40:16.250348 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-59714cce-69d0-415f-8a4f-64e4fa18f92f tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:40:16.250863 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-59714cce-69d0-415f-8a4f-64e4fa18f92f tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:40:16.251303 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-59714cce-69d0-415f-8a4f-64e4fa18f92f tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:40:16.252019 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-59714cce-69d0-415f-8a4f-64e4fa18f92f tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:40:16.252469 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-59714cce-69d0-415f-8a4f-64e4fa18f92f tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:40:16.252892 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-59714cce-69d0-415f-8a4f-64e4fa18f92f tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:40:16.278364 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-59714cce-69d0-415f-8a4f-64e4fa18f92f tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] [instance: 288920f8-c6ff-4a73-a792-1018854830f3] Going to try to terminate instance {{(pid=127196) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 16:40:16.358959 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-59714cce-69d0-415f-8a4f-64e4fa18f92f tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] 10.222.0.23 "DELETE /compute/v2.1/servers/288920f8-c6ff-4a73-a792-1018854830f3" status: 204 len: 0 microversion: 2.1 time: 0.119757 Sep 09 16:40:16.360022 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 483/978] 10.222.0.23 () {58 vars in 1239 bytes} [Fri Sep 9 16:40:16 2022] DELETE /compute/v2.1/servers/288920f8-c6ff-4a73-a792-1018854830f3 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 16:40:16.369659 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-266ee086-4311-48f1-a092-55d10b2df18f tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:40:16.370352 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-266ee086-4311-48f1-a092-55d10b2df18f tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] [instance: 288920f8-c6ff-4a73-a792-1018854830f3] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:40:16.376944 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-266ee086-4311-48f1-a092-55d10b2df18f tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:40:16.377422 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-266ee086-4311-48f1-a092-55d10b2df18f tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:40:16.377850 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-266ee086-4311-48f1-a092-55d10b2df18f tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:40:16.378558 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-266ee086-4311-48f1-a092-55d10b2df18f tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:40:16.379171 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-266ee086-4311-48f1-a092-55d10b2df18f tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:40:16.379590 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-266ee086-4311-48f1-a092-55d10b2df18f tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:40:16.516584 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-266ee086-4311-48f1-a092-55d10b2df18f tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae302ea931a42b5938884e79c2ae381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c6c1e895b5a49009d67f5d7e0ab6058', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:40:16.524218 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-266ee086-4311-48f1-a092-55d10b2df18f tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] 10.222.0.23 "GET /compute/v2.1/servers/288920f8-c6ff-4a73-a792-1018854830f3" status: 200 len: 1514 microversion: 2.1 time: 0.159556 Sep 09 16:40:16.524777 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 496/979] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:40:16 2022] GET /compute/v2.1/servers/288920f8-c6ff-4a73-a792-1018854830f3 => generated 1514 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 16:40:17.550312 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-34bde41b-95b2-4398-9d0e-6b8e5da6fcb5 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:40:17.550902 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-34bde41b-95b2-4398-9d0e-6b8e5da6fcb5 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] [instance: 288920f8-c6ff-4a73-a792-1018854830f3] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:40:17.557459 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-34bde41b-95b2-4398-9d0e-6b8e5da6fcb5 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:40:17.557936 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-34bde41b-95b2-4398-9d0e-6b8e5da6fcb5 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:40:17.558366 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-34bde41b-95b2-4398-9d0e-6b8e5da6fcb5 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:40:17.559080 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-34bde41b-95b2-4398-9d0e-6b8e5da6fcb5 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:40:17.559527 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-34bde41b-95b2-4398-9d0e-6b8e5da6fcb5 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:40:17.560009 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-34bde41b-95b2-4398-9d0e-6b8e5da6fcb5 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:40:17.723457 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-34bde41b-95b2-4398-9d0e-6b8e5da6fcb5 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae302ea931a42b5938884e79c2ae381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c6c1e895b5a49009d67f5d7e0ab6058', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:40:17.731698 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-34bde41b-95b2-4398-9d0e-6b8e5da6fcb5 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] 10.222.0.23 "GET /compute/v2.1/servers/288920f8-c6ff-4a73-a792-1018854830f3" status: 200 len: 1514 microversion: 2.1 time: 0.186505 Sep 09 16:40:17.732350 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 484/980] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:40:17 2022] GET /compute/v2.1/servers/288920f8-c6ff-4a73-a792-1018854830f3 => generated 1514 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:40:18.570657 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [req-046d2686-54f2-4914-9d97-b0b674e500bd req-a441eec7-fac7-4513-9e34-2cdeef46d377 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "288920f8-c6ff-4a73-a792-1018854830f3", "name": "network-vif-deleted", "tag": "722adc14-e173-400d-960f-cf3f1853fb54"}]} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:40:18.581904 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-046d2686-54f2-4914-9d97-b0b674e500bd req-a441eec7-fac7-4513-9e34-2cdeef46d377 service nova] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:40:18.582381 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-046d2686-54f2-4914-9d97-b0b674e500bd req-a441eec7-fac7-4513-9e34-2cdeef46d377 service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:40:18.582834 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-046d2686-54f2-4914-9d97-b0b674e500bd req-a441eec7-fac7-4513-9e34-2cdeef46d377 service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:40:18.586844 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell1:SELECT=73,nova_cell1:INSERT=1 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:40:18.595178 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.compute.server_external_events [req-046d2686-54f2-4914-9d97-b0b674e500bd req-a441eec7-fac7-4513-9e34-2cdeef46d377 service nova] Creating event network-vif-deleted:722adc14-e173-400d-960f-cf3f1853fb54 for instance 288920f8-c6ff-4a73-a792-1018854830f3 on hv-cinder-83124 Sep 09 16:40:18.601324 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [req-046d2686-54f2-4914-9d97-b0b674e500bd req-a441eec7-fac7-4513-9e34-2cdeef46d377 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034671 Sep 09 16:40:18.602179 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 497/981] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Sep 9 16:40:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:40:18.756253 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-7f81421d-7305-4b87-a59b-70cd1cef86e1 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:40:18.756995 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-7f81421d-7305-4b87-a59b-70cd1cef86e1 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] [instance: 288920f8-c6ff-4a73-a792-1018854830f3] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:40:18.764511 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-7f81421d-7305-4b87-a59b-70cd1cef86e1 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:40:18.764995 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-7f81421d-7305-4b87-a59b-70cd1cef86e1 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:40:18.765426 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-7f81421d-7305-4b87-a59b-70cd1cef86e1 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:40:18.766186 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-7f81421d-7305-4b87-a59b-70cd1cef86e1 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:40:18.766885 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-7f81421d-7305-4b87-a59b-70cd1cef86e1 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:40:18.768622 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-7f81421d-7305-4b87-a59b-70cd1cef86e1 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:40:18.771545 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG dbcounter [-] [127196] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=127196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:40:18.803284 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-7f81421d-7305-4b87-a59b-70cd1cef86e1 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:40:18.803779 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-7f81421d-7305-4b87-a59b-70cd1cef86e1 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:40:18.804215 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-7f81421d-7305-4b87-a59b-70cd1cef86e1 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:40:18.804674 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.objects.instance [None req-7f81421d-7305-4b87-a59b-70cd1cef86e1 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Lazy-loading 'fault' on Instance uuid 288920f8-c6ff-4a73-a792-1018854830f3 {{(pid=127196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 16:40:18.848319 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-7f81421d-7305-4b87-a59b-70cd1cef86e1 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae302ea931a42b5938884e79c2ae381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c6c1e895b5a49009d67f5d7e0ab6058', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:40:18.856417 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-7f81421d-7305-4b87-a59b-70cd1cef86e1 tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] 10.222.0.23 "GET /compute/v2.1/servers/288920f8-c6ff-4a73-a792-1018854830f3" status: 200 len: 1308 microversion: 2.1 time: 0.105384 Sep 09 16:40:18.857310 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 485/982] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:40:18 2022] GET /compute/v2.1/servers/288920f8-c6ff-4a73-a792-1018854830f3 => generated 1308 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:40:19.881317 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-98d05127-1907-4ec5-b882-8622b323aafc tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:40:19.882018 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-98d05127-1907-4ec5-b882-8622b323aafc tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] [instance: 288920f8-c6ff-4a73-a792-1018854830f3] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:40:19.888554 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-98d05127-1907-4ec5-b882-8622b323aafc tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:40:19.889033 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-98d05127-1907-4ec5-b882-8622b323aafc tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:40:19.889459 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-98d05127-1907-4ec5-b882-8622b323aafc tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:40:19.890139 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-98d05127-1907-4ec5-b882-8622b323aafc tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:40:19.890617 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-98d05127-1907-4ec5-b882-8622b323aafc tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:40:19.891037 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-98d05127-1907-4ec5-b882-8622b323aafc tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:40:19.904204 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.wsgi [None req-98d05127-1907-4ec5-b882-8622b323aafc tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] HTTP exception thrown: Instance 288920f8-c6ff-4a73-a792-1018854830f3 could not be found. Sep 09 16:40:19.905862 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-98d05127-1907-4ec5-b882-8622b323aafc tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Request method failure captured: Sep 09 16:40:19.905862 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: request: GET /compute/v2.1/servers/288920f8-c6ff-4a73-a792-1018854830f3 HTTP/1.1 Sep 09 16:40:19.905862 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Accept: application/json Sep 09 16:40:19.905862 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Accept-Encoding: identity Sep 09 16:40:19.905862 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Connection: close Sep 09 16:40:19.905862 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Content-Length: 0 Sep 09 16:40:19.905862 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Content-Type: application/json Sep 09 16:40:19.905862 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Host: 10.222.0.23 Sep 09 16:40:19.905862 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Openstack-System-Scope: None Sep 09 16:40:19.905862 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: User-Agent: python-urllib3/1.26.12 Sep 09 16:40:19.905862 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Auth-Token: gAAAAABjG2v_crC6EjHdkptc_uB0kEsFOo25fN7AjhXYzEkU9a6jZfmpsuFxASJGdXyg37_XntIBAu6Om-6p79YpsKhBsy1lvy6WzXBKV_AI0rzCVN3jzGjmTaeC_Gcgqb9uocDFt0I9vbiiU2futN5uG0zOmW8gfZxJdwVttncJ8QYJfBRpJvE Sep 09 16:40:19.905862 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Domain-Id: None Sep 09 16:40:19.905862 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Domain-Name: None Sep 09 16:40:19.905862 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Identity-Status: Confirmed Sep 09 16:40:19.905862 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Is-Admin-Project: True Sep 09 16:40:19.905862 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Project-Domain-Id: default Sep 09 16:40:19.905862 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Project-Domain-Name: Default Sep 09 16:40:19.905862 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Project-Id: 1c6c1e895b5a49009d67f5d7e0ab6058 Sep 09 16:40:19.905862 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1643251043 Sep 09 16:40:19.905862 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Role: member,reader Sep 09 16:40:19.905862 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Roles: member,reader Sep 09 16:40:19.907513 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1c6c1e895b5a49009d67f5d7e0ab6058"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1c6c1e895b5a49009d67f5d7e0ab6058"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1c6c1e895b5a49009d67f5d7e0ab6058"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1c6c1e895b5a49009d67f5d7e0ab6058"}]}] Sep 09 16:40:19.907513 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Tenant: tempest-VolumesSnapshotTestJSON-1643251043 Sep 09 16:40:19.907513 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Tenant-Id: 1c6c1e895b5a49009d67f5d7e0ab6058 Sep 09 16:40:19.907513 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1643251043 Sep 09 16:40:19.907513 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User: tempest-VolumesSnapshotTestJSON-1643251043-project Sep 09 16:40:19.907513 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User-Domain-Id: default Sep 09 16:40:19.907513 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User-Domain-Name: Default Sep 09 16:40:19.907513 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User-Id: 5ae302ea931a42b5938884e79c2ae381 Sep 09 16:40:19.907513 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User-Name: tempest-VolumesSnapshotTestJSON-1643251043-project Sep 09 16:40:19.907513 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: method: > Sep 09 16:40:19.907513 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: exception: Instance 288920f8-c6ff-4a73-a792-1018854830f3 could not be found. Sep 09 16:40:19.907513 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: action_args: {'id': '288920f8-c6ff-4a73-a792-1018854830f3'} Sep 09 16:40:19.908748 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 16:40:19.908748 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:40:19.908748 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 16:40:19.908748 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 16:40:19.908748 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 16:40:19.908748 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 16:40:19.908748 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 16:40:19.908748 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 16:40:19.908748 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 16:40:19.908748 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 16:40:19.908748 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 288920f8-c6ff-4a73-a792-1018854830f3 could not be found. Sep 09 16:40:19.908748 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:40:19.908748 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 16:40:19.908748 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:40:19.908748 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:40:19.908748 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 16:40:19.908748 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 16:40:19.908748 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 16:40:19.908748 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 16:40:19.908748 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 16:40:19.910608 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 16:40:19.910608 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 16:40:19.910608 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 16:40:19.910608 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 16:40:19.910608 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 16:40:19.910608 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 16:40:19.910608 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 16:40:19.910608 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 288920f8-c6ff-4a73-a792-1018854830f3 could not be found. Sep 09 16:40:19.910608 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:40:19.910608 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 16:40:19.910608 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:40:19.910608 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:40:19.910608 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 16:40:19.910608 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 16:40:19.910608 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 16:40:19.910608 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 16:40:19.910608 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 288920f8-c6ff-4a73-a792-1018854830f3 could not be found. Sep 09 16:40:19.910608 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:40:19.912124 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-98d05127-1907-4ec5-b882-8622b323aafc tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] Returning 404 to user: Instance 288920f8-c6ff-4a73-a792-1018854830f3 could not be found. {{(pid=127198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 16:40:19.912124 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-98d05127-1907-4ec5-b882-8622b323aafc tempest-VolumesSnapshotTestJSON-1643251043 tempest-VolumesSnapshotTestJSON-1643251043-project] 10.222.0.23 "GET /compute/v2.1/servers/288920f8-c6ff-4a73-a792-1018854830f3" status: 404 len: 111 microversion: 2.1 time: 0.030791 Sep 09 16:40:19.912124 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 498/983] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:40:19 2022] GET /compute/v2.1/servers/288920f8-c6ff-4a73-a792-1018854830f3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 16:40:23.730798 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-40702a1c-70e3-4c42-b428-dc6b887a6864 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:40:23.733394 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-40702a1c-70e3-4c42-b428-dc6b887a6864 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] [instance: 667d78d5-e585-4ce5-a240-797cf2202816] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:40:23.741762 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-40702a1c-70e3-4c42-b428-dc6b887a6864 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:40:23.742247 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-40702a1c-70e3-4c42-b428-dc6b887a6864 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:40:23.742816 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-40702a1c-70e3-4c42-b428-dc6b887a6864 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:40:23.743613 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-40702a1c-70e3-4c42-b428-dc6b887a6864 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:40:23.744348 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-40702a1c-70e3-4c42-b428-dc6b887a6864 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:40:23.744626 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-40702a1c-70e3-4c42-b428-dc6b887a6864 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:40:23.838055 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-40702a1c-70e3-4c42-b428-dc6b887a6864 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] 10.222.0.23 "POST /compute/v2.1/servers/667d78d5-e585-4ce5-a240-797cf2202816/action" status: 202 len: 0 microversion: 2.1 time: 0.113245 Sep 09 16:40:23.838753 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 486/984] 10.222.0.23 () {60 vars in 1278 bytes} [Fri Sep 9 16:40:23 2022] POST /compute/v2.1/servers/667d78d5-e585-4ce5-a240-797cf2202816/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 16:40:23.847025 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-3befa32a-143c-4feb-a29b-c84c81ebc3cd tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:40:23.847680 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-3befa32a-143c-4feb-a29b-c84c81ebc3cd tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] [instance: 667d78d5-e585-4ce5-a240-797cf2202816] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:40:23.854567 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3befa32a-143c-4feb-a29b-c84c81ebc3cd tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:40:23.855056 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3befa32a-143c-4feb-a29b-c84c81ebc3cd tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:40:23.855479 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3befa32a-143c-4feb-a29b-c84c81ebc3cd tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:40:23.856175 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3befa32a-143c-4feb-a29b-c84c81ebc3cd tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:40:23.856627 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3befa32a-143c-4feb-a29b-c84c81ebc3cd tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:40:23.857270 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3befa32a-143c-4feb-a29b-c84c81ebc3cd tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:40:24.005922 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-3befa32a-143c-4feb-a29b-c84c81ebc3cd tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86d1ec821814f628879590513702cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5daf9e9245447dac44278ce813b4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:40:24.019112 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-3befa32a-143c-4feb-a29b-c84c81ebc3cd tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] 10.222.0.23 "GET /compute/v2.1/servers/667d78d5-e585-4ce5-a240-797cf2202816" status: 200 len: 1751 microversion: 2.1 time: 0.175905 Sep 09 16:40:24.019985 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 499/985] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:40:23 2022] GET /compute/v2.1/servers/667d78d5-e585-4ce5-a240-797cf2202816 => generated 1751 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:40:25.046129 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-e58cfae6-c6da-41c5-bed9-fe28291cc75c tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:40:25.047206 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-e58cfae6-c6da-41c5-bed9-fe28291cc75c tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] [instance: 667d78d5-e585-4ce5-a240-797cf2202816] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:40:25.054328 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e58cfae6-c6da-41c5-bed9-fe28291cc75c tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:40:25.054834 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e58cfae6-c6da-41c5-bed9-fe28291cc75c tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:40:25.055240 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e58cfae6-c6da-41c5-bed9-fe28291cc75c tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:40:25.056122 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e58cfae6-c6da-41c5-bed9-fe28291cc75c tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:40:25.056614 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e58cfae6-c6da-41c5-bed9-fe28291cc75c tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:40:25.057204 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e58cfae6-c6da-41c5-bed9-fe28291cc75c tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:40:25.207620 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-e58cfae6-c6da-41c5-bed9-fe28291cc75c tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86d1ec821814f628879590513702cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5daf9e9245447dac44278ce813b4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:40:25.216248 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-e58cfae6-c6da-41c5-bed9-fe28291cc75c tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] 10.222.0.23 "GET /compute/v2.1/servers/667d78d5-e585-4ce5-a240-797cf2202816" status: 200 len: 1756 microversion: 2.1 time: 0.175589 Sep 09 16:40:25.216820 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 487/986] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:40:25 2022] GET /compute/v2.1/servers/667d78d5-e585-4ce5-a240-797cf2202816 => generated 1756 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:40:26.240921 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-fb74e7fc-06dc-4de9-89a6-af84d6a553f7 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:40:26.241497 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-fb74e7fc-06dc-4de9-89a6-af84d6a553f7 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] [instance: 667d78d5-e585-4ce5-a240-797cf2202816] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:40:26.243728 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_api:SELECT=32 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:40:26.249165 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fb74e7fc-06dc-4de9-89a6-af84d6a553f7 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:40:26.249643 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fb74e7fc-06dc-4de9-89a6-af84d6a553f7 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:40:26.250071 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fb74e7fc-06dc-4de9-89a6-af84d6a553f7 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:40:26.250794 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fb74e7fc-06dc-4de9-89a6-af84d6a553f7 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:40:26.251245 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fb74e7fc-06dc-4de9-89a6-af84d6a553f7 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:40:26.251662 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fb74e7fc-06dc-4de9-89a6-af84d6a553f7 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:40:26.400536 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-fb74e7fc-06dc-4de9-89a6-af84d6a553f7 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86d1ec821814f628879590513702cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5daf9e9245447dac44278ce813b4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:40:26.409044 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-fb74e7fc-06dc-4de9-89a6-af84d6a553f7 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] 10.222.0.23 "GET /compute/v2.1/servers/667d78d5-e585-4ce5-a240-797cf2202816" status: 200 len: 1756 microversion: 2.1 time: 0.172292 Sep 09 16:40:26.409608 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 500/987] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:40:26 2022] GET /compute/v2.1/servers/667d78d5-e585-4ce5-a240-797cf2202816 => generated 1756 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:40:27.436950 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-0bb7ba22-d8bd-4c1a-8da8-11950121e3e6 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:40:27.437912 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-0bb7ba22-d8bd-4c1a-8da8-11950121e3e6 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] [instance: 667d78d5-e585-4ce5-a240-797cf2202816] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:40:27.448666 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-0bb7ba22-d8bd-4c1a-8da8-11950121e3e6 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:40:27.449140 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-0bb7ba22-d8bd-4c1a-8da8-11950121e3e6 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:40:27.449554 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-0bb7ba22-d8bd-4c1a-8da8-11950121e3e6 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:40:27.450314 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-0bb7ba22-d8bd-4c1a-8da8-11950121e3e6 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:40:27.450794 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-0bb7ba22-d8bd-4c1a-8da8-11950121e3e6 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:40:27.451207 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-0bb7ba22-d8bd-4c1a-8da8-11950121e3e6 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:40:27.615870 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-0bb7ba22-d8bd-4c1a-8da8-11950121e3e6 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86d1ec821814f628879590513702cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5daf9e9245447dac44278ce813b4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:40:27.624297 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-0bb7ba22-d8bd-4c1a-8da8-11950121e3e6 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] 10.222.0.23 "GET /compute/v2.1/servers/667d78d5-e585-4ce5-a240-797cf2202816" status: 200 len: 1756 microversion: 2.1 time: 0.194159 Sep 09 16:40:27.624860 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 488/988] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:40:27 2022] GET /compute/v2.1/servers/667d78d5-e585-4ce5-a240-797cf2202816 => generated 1756 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:40:28.647612 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-3cdc0f54-98b3-4f75-909f-531ba4d73d2a tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:40:28.648202 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-3cdc0f54-98b3-4f75-909f-531ba4d73d2a tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] [instance: 667d78d5-e585-4ce5-a240-797cf2202816] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:40:28.655792 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3cdc0f54-98b3-4f75-909f-531ba4d73d2a tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:40:28.656599 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3cdc0f54-98b3-4f75-909f-531ba4d73d2a tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:40:28.657725 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3cdc0f54-98b3-4f75-909f-531ba4d73d2a tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:40:28.658878 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3cdc0f54-98b3-4f75-909f-531ba4d73d2a tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:40:28.659746 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3cdc0f54-98b3-4f75-909f-531ba4d73d2a tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:40:28.660634 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3cdc0f54-98b3-4f75-909f-531ba4d73d2a tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:40:28.813018 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-3cdc0f54-98b3-4f75-909f-531ba4d73d2a tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86d1ec821814f628879590513702cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5daf9e9245447dac44278ce813b4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:40:28.821277 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-3cdc0f54-98b3-4f75-909f-531ba4d73d2a tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] 10.222.0.23 "GET /compute/v2.1/servers/667d78d5-e585-4ce5-a240-797cf2202816" status: 200 len: 1756 microversion: 2.1 time: 0.177717 Sep 09 16:40:28.821856 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 501/989] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:40:28 2022] GET /compute/v2.1/servers/667d78d5-e585-4ce5-a240-797cf2202816 => generated 1756 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:40:29.844853 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-8b985b09-860d-44aa-8440-673abf142bbc tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:40:29.845549 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-8b985b09-860d-44aa-8440-673abf142bbc tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] [instance: 667d78d5-e585-4ce5-a240-797cf2202816] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:40:29.852544 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-8b985b09-860d-44aa-8440-673abf142bbc tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:40:29.853009 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-8b985b09-860d-44aa-8440-673abf142bbc tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:40:29.853445 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-8b985b09-860d-44aa-8440-673abf142bbc tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:40:29.854138 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-8b985b09-860d-44aa-8440-673abf142bbc tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:40:29.854628 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-8b985b09-860d-44aa-8440-673abf142bbc tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:40:29.855075 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-8b985b09-860d-44aa-8440-673abf142bbc tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:40:29.999854 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-8b985b09-860d-44aa-8440-673abf142bbc tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86d1ec821814f628879590513702cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5daf9e9245447dac44278ce813b4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:40:30.008352 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-8b985b09-860d-44aa-8440-673abf142bbc tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] 10.222.0.23 "GET /compute/v2.1/servers/667d78d5-e585-4ce5-a240-797cf2202816" status: 200 len: 1756 microversion: 2.1 time: 0.167546 Sep 09 16:40:30.008915 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 489/990] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:40:29 2022] GET /compute/v2.1/servers/667d78d5-e585-4ce5-a240-797cf2202816 => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:40:31.035511 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-deb9f4da-5135-46cd-a989-3b117718a0e1 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:40:31.036210 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-deb9f4da-5135-46cd-a989-3b117718a0e1 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] [instance: 667d78d5-e585-4ce5-a240-797cf2202816] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:40:31.046249 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-deb9f4da-5135-46cd-a989-3b117718a0e1 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:40:31.046767 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-deb9f4da-5135-46cd-a989-3b117718a0e1 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:40:31.047196 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-deb9f4da-5135-46cd-a989-3b117718a0e1 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:40:31.047882 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-deb9f4da-5135-46cd-a989-3b117718a0e1 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:40:31.048331 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-deb9f4da-5135-46cd-a989-3b117718a0e1 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:40:31.048753 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-deb9f4da-5135-46cd-a989-3b117718a0e1 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:40:31.196967 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-deb9f4da-5135-46cd-a989-3b117718a0e1 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86d1ec821814f628879590513702cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5daf9e9245447dac44278ce813b4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:40:31.205402 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-deb9f4da-5135-46cd-a989-3b117718a0e1 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] 10.222.0.23 "GET /compute/v2.1/servers/667d78d5-e585-4ce5-a240-797cf2202816" status: 200 len: 1756 microversion: 2.1 time: 0.176821 Sep 09 16:40:31.205970 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 502/991] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:40:31 2022] GET /compute/v2.1/servers/667d78d5-e585-4ce5-a240-797cf2202816 => generated 1756 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:40:32.229476 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-db767519-308e-41f8-ba1e-57cfbb34e075 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:40:32.230080 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-db767519-308e-41f8-ba1e-57cfbb34e075 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] [instance: 667d78d5-e585-4ce5-a240-797cf2202816] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:40:32.236759 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-db767519-308e-41f8-ba1e-57cfbb34e075 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:40:32.237247 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-db767519-308e-41f8-ba1e-57cfbb34e075 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:40:32.237675 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-db767519-308e-41f8-ba1e-57cfbb34e075 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:40:32.238390 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-db767519-308e-41f8-ba1e-57cfbb34e075 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:40:32.238888 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-db767519-308e-41f8-ba1e-57cfbb34e075 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:40:32.239290 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-db767519-308e-41f8-ba1e-57cfbb34e075 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:40:32.391744 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-db767519-308e-41f8-ba1e-57cfbb34e075 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86d1ec821814f628879590513702cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5daf9e9245447dac44278ce813b4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:40:32.399996 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-db767519-308e-41f8-ba1e-57cfbb34e075 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] 10.222.0.23 "GET /compute/v2.1/servers/667d78d5-e585-4ce5-a240-797cf2202816" status: 200 len: 1756 microversion: 2.1 time: 0.174682 Sep 09 16:40:32.400562 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 490/992] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:40:32 2022] GET /compute/v2.1/servers/667d78d5-e585-4ce5-a240-797cf2202816 => generated 1756 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:40:33.426415 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-1d86ab92-50c6-40eb-9753-6a80f5e98725 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:40:33.427053 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-1d86ab92-50c6-40eb-9753-6a80f5e98725 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] [instance: 667d78d5-e585-4ce5-a240-797cf2202816] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:40:33.433532 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1d86ab92-50c6-40eb-9753-6a80f5e98725 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:40:33.434006 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1d86ab92-50c6-40eb-9753-6a80f5e98725 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:40:33.434448 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1d86ab92-50c6-40eb-9753-6a80f5e98725 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:40:33.435193 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1d86ab92-50c6-40eb-9753-6a80f5e98725 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:40:33.435637 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1d86ab92-50c6-40eb-9753-6a80f5e98725 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:40:33.436073 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1d86ab92-50c6-40eb-9753-6a80f5e98725 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:40:33.585305 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-1d86ab92-50c6-40eb-9753-6a80f5e98725 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86d1ec821814f628879590513702cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5daf9e9245447dac44278ce813b4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:40:33.593954 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-1d86ab92-50c6-40eb-9753-6a80f5e98725 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] 10.222.0.23 "GET /compute/v2.1/servers/667d78d5-e585-4ce5-a240-797cf2202816" status: 200 len: 1756 microversion: 2.1 time: 0.171389 Sep 09 16:40:33.594538 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 503/993] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:40:33 2022] GET /compute/v2.1/servers/667d78d5-e585-4ce5-a240-797cf2202816 => generated 1756 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:40:34.617274 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-f2ece836-702e-4e7d-8602-4cb391b2588f tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:40:34.617867 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-f2ece836-702e-4e7d-8602-4cb391b2588f tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] [instance: 667d78d5-e585-4ce5-a240-797cf2202816] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:40:34.624684 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f2ece836-702e-4e7d-8602-4cb391b2588f tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:40:34.625163 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f2ece836-702e-4e7d-8602-4cb391b2588f tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:40:34.625588 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f2ece836-702e-4e7d-8602-4cb391b2588f tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:40:34.626277 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f2ece836-702e-4e7d-8602-4cb391b2588f tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:40:34.626766 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f2ece836-702e-4e7d-8602-4cb391b2588f tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:40:34.627250 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f2ece836-702e-4e7d-8602-4cb391b2588f tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:40:34.774101 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-f2ece836-702e-4e7d-8602-4cb391b2588f tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86d1ec821814f628879590513702cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5daf9e9245447dac44278ce813b4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:40:34.782455 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-f2ece836-702e-4e7d-8602-4cb391b2588f tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] 10.222.0.23 "GET /compute/v2.1/servers/667d78d5-e585-4ce5-a240-797cf2202816" status: 200 len: 1756 microversion: 2.1 time: 0.169163 Sep 09 16:40:34.783051 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 491/994] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:40:34 2022] GET /compute/v2.1/servers/667d78d5-e585-4ce5-a240-797cf2202816 => generated 1756 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:40:35.211512 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-9293ed80-ea9c-4045-9ac2-6b97a7addfa3 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:40:35.212702 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-9293ed80-ea9c-4045-9ac2-6b97a7addfa3 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] [instance: 9bed6256-fc6f-40dd-b465-54981581a6aa] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:40:35.214891 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [req-73dda6ca-8c07-4708-9805-902c27b55fd5 req-8019fa5d-9936-4cb6-a398-63433cf5d56e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9bed6256-fc6f-40dd-b465-54981581a6aa", "tag": "7151e062-a48c-4cc1-be6e-dbf4d66de6e4"}]} {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:40:35.220918 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9293ed80-ea9c-4045-9ac2-6b97a7addfa3 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:40:35.221648 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9293ed80-ea9c-4045-9ac2-6b97a7addfa3 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:40:35.222288 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9293ed80-ea9c-4045-9ac2-6b97a7addfa3 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:40:35.223502 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9293ed80-ea9c-4045-9ac2-6b97a7addfa3 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:40:35.224278 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9293ed80-ea9c-4045-9ac2-6b97a7addfa3 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:40:35.224909 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9293ed80-ea9c-4045-9ac2-6b97a7addfa3 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:40:35.238628 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [req-73dda6ca-8c07-4708-9805-902c27b55fd5 req-8019fa5d-9936-4cb6-a398-63433cf5d56e service nova] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:40:35.242663 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [req-73dda6ca-8c07-4708-9805-902c27b55fd5 req-8019fa5d-9936-4cb6-a398-63433cf5d56e service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:40:35.243426 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [req-73dda6ca-8c07-4708-9805-902c27b55fd5 req-8019fa5d-9936-4cb6-a398-63433cf5d56e service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:40:35.253334 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-9293ed80-ea9c-4045-9ac2-6b97a7addfa3 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] [instance: 9bed6256-fc6f-40dd-b465-54981581a6aa] Going to try to terminate instance {{(pid=127198) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 16:40:35.276088 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.compute.server_external_events [req-73dda6ca-8c07-4708-9805-902c27b55fd5 req-8019fa5d-9936-4cb6-a398-63433cf5d56e service nova] Creating event network-changed:7151e062-a48c-4cc1-be6e-dbf4d66de6e4 for instance 9bed6256-fc6f-40dd-b465-54981581a6aa on hv-cinder-83124 Sep 09 16:40:35.289859 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [req-73dda6ca-8c07-4708-9805-902c27b55fd5 req-8019fa5d-9936-4cb6-a398-63433cf5d56e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077575 Sep 09 16:40:35.290391 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 492/995] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Sep 9 16:40:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:40:35.393300 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-9293ed80-ea9c-4045-9ac2-6b97a7addfa3 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] 10.222.0.23 "DELETE /compute/v2.1/servers/9bed6256-fc6f-40dd-b465-54981581a6aa" status: 204 len: 0 microversion: 2.1 time: 0.185625 Sep 09 16:40:35.393917 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 504/996] 10.222.0.23 () {58 vars in 1239 bytes} [Fri Sep 9 16:40:35 2022] DELETE /compute/v2.1/servers/9bed6256-fc6f-40dd-b465-54981581a6aa => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 16:40:35.403961 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-443812c7-8d9e-4cea-9a51-17b92f290e2b tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:40:35.404770 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-443812c7-8d9e-4cea-9a51-17b92f290e2b tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] [instance: 9bed6256-fc6f-40dd-b465-54981581a6aa] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:40:35.412390 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-443812c7-8d9e-4cea-9a51-17b92f290e2b tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:40:35.413116 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-443812c7-8d9e-4cea-9a51-17b92f290e2b tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:40:35.413759 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-443812c7-8d9e-4cea-9a51-17b92f290e2b tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:40:35.414435 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-443812c7-8d9e-4cea-9a51-17b92f290e2b tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:40:35.414925 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-443812c7-8d9e-4cea-9a51-17b92f290e2b tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:40:35.415348 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-443812c7-8d9e-4cea-9a51-17b92f290e2b tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:40:35.574029 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-443812c7-8d9e-4cea-9a51-17b92f290e2b tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208daa6413d34e4496e278fb3fc251a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba803ac5e71467f853215e19a7f8867', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:40:35.582623 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-443812c7-8d9e-4cea-9a51-17b92f290e2b tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] 10.222.0.23 "GET /compute/v2.1/servers/9bed6256-fc6f-40dd-b465-54981581a6aa" status: 200 len: 1568 microversion: 2.1 time: 0.183851 Sep 09 16:40:35.583193 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 493/997] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:40:35 2022] GET /compute/v2.1/servers/9bed6256-fc6f-40dd-b465-54981581a6aa => generated 1568 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:40:35.812369 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-802aacb4-3f54-4088-872f-85ec66fe0416 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:40:35.813654 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-802aacb4-3f54-4088-872f-85ec66fe0416 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] [instance: 667d78d5-e585-4ce5-a240-797cf2202816] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:40:35.823716 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-802aacb4-3f54-4088-872f-85ec66fe0416 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:40:35.825687 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-802aacb4-3f54-4088-872f-85ec66fe0416 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:40:35.826781 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-802aacb4-3f54-4088-872f-85ec66fe0416 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:40:35.828348 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-802aacb4-3f54-4088-872f-85ec66fe0416 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:40:35.829127 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-802aacb4-3f54-4088-872f-85ec66fe0416 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:40:35.837243 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-802aacb4-3f54-4088-872f-85ec66fe0416 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:40:35.988427 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-802aacb4-3f54-4088-872f-85ec66fe0416 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86d1ec821814f628879590513702cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5daf9e9245447dac44278ce813b4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:40:35.997156 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-802aacb4-3f54-4088-872f-85ec66fe0416 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] 10.222.0.23 "GET /compute/v2.1/servers/667d78d5-e585-4ce5-a240-797cf2202816" status: 200 len: 1756 microversion: 2.1 time: 0.192811 Sep 09 16:40:35.997826 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 505/998] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:40:35 2022] GET /compute/v2.1/servers/667d78d5-e585-4ce5-a240-797cf2202816 => generated 1756 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:40:36.605500 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-4d0950a4-305a-4cb4-9c8e-069af76a7030 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:40:36.606089 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-4d0950a4-305a-4cb4-9c8e-069af76a7030 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] [instance: 9bed6256-fc6f-40dd-b465-54981581a6aa] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:40:36.613002 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-4d0950a4-305a-4cb4-9c8e-069af76a7030 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:40:36.613480 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-4d0950a4-305a-4cb4-9c8e-069af76a7030 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:40:36.613952 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-4d0950a4-305a-4cb4-9c8e-069af76a7030 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:40:36.614691 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-4d0950a4-305a-4cb4-9c8e-069af76a7030 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:40:36.615141 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-4d0950a4-305a-4cb4-9c8e-069af76a7030 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:40:36.615559 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-4d0950a4-305a-4cb4-9c8e-069af76a7030 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:40:36.764649 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-4d0950a4-305a-4cb4-9c8e-069af76a7030 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208daa6413d34e4496e278fb3fc251a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba803ac5e71467f853215e19a7f8867', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:40:36.772439 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-4d0950a4-305a-4cb4-9c8e-069af76a7030 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] 10.222.0.23 "GET /compute/v2.1/servers/9bed6256-fc6f-40dd-b465-54981581a6aa" status: 200 len: 1568 microversion: 2.1 time: 0.170943 Sep 09 16:40:36.773008 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 494/999] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:40:36 2022] GET /compute/v2.1/servers/9bed6256-fc6f-40dd-b465-54981581a6aa => generated 1568 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:40:37.021255 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-257e8b09-e255-4cb7-be54-01ea63ad671c tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:40:37.022139 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-257e8b09-e255-4cb7-be54-01ea63ad671c tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] [instance: 667d78d5-e585-4ce5-a240-797cf2202816] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:40:37.029136 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-257e8b09-e255-4cb7-be54-01ea63ad671c tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:40:37.029620 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-257e8b09-e255-4cb7-be54-01ea63ad671c tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:40:37.030154 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-257e8b09-e255-4cb7-be54-01ea63ad671c tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:40:37.030754 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-257e8b09-e255-4cb7-be54-01ea63ad671c tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:40:37.031398 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-257e8b09-e255-4cb7-be54-01ea63ad671c tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:40:37.031830 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-257e8b09-e255-4cb7-be54-01ea63ad671c tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:40:37.485217 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-257e8b09-e255-4cb7-be54-01ea63ad671c tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86d1ec821814f628879590513702cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5daf9e9245447dac44278ce813b4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:40:37.493736 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-257e8b09-e255-4cb7-be54-01ea63ad671c tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] 10.222.0.23 "GET /compute/v2.1/servers/667d78d5-e585-4ce5-a240-797cf2202816" status: 200 len: 1759 microversion: 2.1 time: 0.476729 Sep 09 16:40:37.494321 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 506/1000] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:40:37 2022] GET /compute/v2.1/servers/667d78d5-e585-4ce5-a240-797cf2202816 => generated 1759 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:40:37.797415 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-dcc88364-0977-4392-b756-ae1d6292c140 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:40:37.798056 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-dcc88364-0977-4392-b756-ae1d6292c140 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] [instance: 9bed6256-fc6f-40dd-b465-54981581a6aa] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:40:37.804806 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-dcc88364-0977-4392-b756-ae1d6292c140 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:40:37.805703 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-dcc88364-0977-4392-b756-ae1d6292c140 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:40:37.806134 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-dcc88364-0977-4392-b756-ae1d6292c140 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:40:37.807283 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-dcc88364-0977-4392-b756-ae1d6292c140 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:40:37.807887 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-dcc88364-0977-4392-b756-ae1d6292c140 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:40:37.808453 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-dcc88364-0977-4392-b756-ae1d6292c140 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:40:38.012651 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-dcc88364-0977-4392-b756-ae1d6292c140 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208daa6413d34e4496e278fb3fc251a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba803ac5e71467f853215e19a7f8867', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:40:38.020682 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-dcc88364-0977-4392-b756-ae1d6292c140 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] 10.222.0.23 "GET /compute/v2.1/servers/9bed6256-fc6f-40dd-b465-54981581a6aa" status: 200 len: 1449 microversion: 2.1 time: 0.228338 Sep 09 16:40:38.021375 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 495/1001] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:40:37 2022] GET /compute/v2.1/servers/9bed6256-fc6f-40dd-b465-54981581a6aa => generated 1449 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:40:38.130782 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [req-4d99fd22-2371-4ee4-9b08-84a6a51de2b2 req-d1c920ff-90b8-42ee-ad6b-b75b00656e43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bed6256-fc6f-40dd-b465-54981581a6aa", "name": "network-vif-deleted", "tag": "7151e062-a48c-4cc1-be6e-dbf4d66de6e4"}]} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:40:38.145299 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-4d99fd22-2371-4ee4-9b08-84a6a51de2b2 req-d1c920ff-90b8-42ee-ad6b-b75b00656e43 service nova] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:40:38.145784 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-4d99fd22-2371-4ee4-9b08-84a6a51de2b2 req-d1c920ff-90b8-42ee-ad6b-b75b00656e43 service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:40:38.146189 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-4d99fd22-2371-4ee4-9b08-84a6a51de2b2 req-d1c920ff-90b8-42ee-ad6b-b75b00656e43 service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:40:38.162180 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.compute.server_external_events [req-4d99fd22-2371-4ee4-9b08-84a6a51de2b2 req-d1c920ff-90b8-42ee-ad6b-b75b00656e43 service nova] Creating event network-vif-deleted:7151e062-a48c-4cc1-be6e-dbf4d66de6e4 for instance 9bed6256-fc6f-40dd-b465-54981581a6aa on hv-cinder-83124 Sep 09 16:40:38.166856 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [req-4d99fd22-2371-4ee4-9b08-84a6a51de2b2 req-d1c920ff-90b8-42ee-ad6b-b75b00656e43 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039751 Sep 09 16:40:38.167447 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 507/1002] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Sep 9 16:40:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:40:39.047202 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-7f2ee0a3-84a9-4645-9ab9-84255d9175f3 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:40:39.047821 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-7f2ee0a3-84a9-4645-9ab9-84255d9175f3 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] [instance: 9bed6256-fc6f-40dd-b465-54981581a6aa] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:40:39.050211 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG dbcounter [-] [127196] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=127196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:40:39.055755 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-7f2ee0a3-84a9-4645-9ab9-84255d9175f3 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:40:39.056895 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-7f2ee0a3-84a9-4645-9ab9-84255d9175f3 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:40:39.057342 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-7f2ee0a3-84a9-4645-9ab9-84255d9175f3 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:40:39.058054 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-7f2ee0a3-84a9-4645-9ab9-84255d9175f3 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:40:39.058535 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-7f2ee0a3-84a9-4645-9ab9-84255d9175f3 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:40:39.058960 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-7f2ee0a3-84a9-4645-9ab9-84255d9175f3 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:40:39.083324 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.wsgi [None req-7f2ee0a3-84a9-4645-9ab9-84255d9175f3 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] HTTP exception thrown: Instance 9bed6256-fc6f-40dd-b465-54981581a6aa could not be found. Sep 09 16:40:39.085070 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-7f2ee0a3-84a9-4645-9ab9-84255d9175f3 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Request method failure captured: Sep 09 16:40:39.085070 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: request: GET /compute/v2.1/servers/9bed6256-fc6f-40dd-b465-54981581a6aa HTTP/1.1 Sep 09 16:40:39.085070 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Accept: application/json Sep 09 16:40:39.085070 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Accept-Encoding: identity Sep 09 16:40:39.085070 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Connection: close Sep 09 16:40:39.085070 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Content-Length: 0 Sep 09 16:40:39.085070 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Content-Type: application/json Sep 09 16:40:39.085070 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Host: 10.222.0.23 Sep 09 16:40:39.085070 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Openstack-System-Scope: None Sep 09 16:40:39.085070 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: User-Agent: python-urllib3/1.26.12 Sep 09 16:40:39.085070 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Auth-Token: gAAAAABjG2tQs8-twqEwMjWVB_10fiFcgC1f5zdyIeq0zF9V_wfYkUSp05FU0zpqNHOizOtpqxcGi1SC8XxQM18dJfYAG1at_8ZBURacxkM2RIGQyFKsa_unAJkx4ccvgY_6folCfNrXeAK9fx2_1gALFN-QsQLyJ5qZ7DC8lmV14tfK1DrIVFM Sep 09 16:40:39.085070 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Domain-Id: None Sep 09 16:40:39.085070 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Domain-Name: None Sep 09 16:40:39.085070 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Identity-Status: Confirmed Sep 09 16:40:39.085070 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Is-Admin-Project: True Sep 09 16:40:39.085070 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Project-Domain-Id: default Sep 09 16:40:39.085070 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Project-Domain-Name: Default Sep 09 16:40:39.085070 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Project-Id: 1ba803ac5e71467f853215e19a7f8867 Sep 09 16:40:39.085070 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Project-Name: tempest-TestShelveInstance-1059815970 Sep 09 16:40:39.085070 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Role: member,reader Sep 09 16:40:39.085070 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Roles: member,reader Sep 09 16:40:39.086571 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1ba803ac5e71467f853215e19a7f8867"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1ba803ac5e71467f853215e19a7f8867"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1ba803ac5e71467f853215e19a7f8867"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1ba803ac5e71467f853215e19a7f8867"}]}] Sep 09 16:40:39.086571 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Tenant: tempest-TestShelveInstance-1059815970 Sep 09 16:40:39.086571 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Tenant-Id: 1ba803ac5e71467f853215e19a7f8867 Sep 09 16:40:39.086571 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Tenant-Name: tempest-TestShelveInstance-1059815970 Sep 09 16:40:39.086571 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-User: tempest-TestShelveInstance-1059815970-project Sep 09 16:40:39.086571 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-User-Domain-Id: default Sep 09 16:40:39.086571 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-User-Domain-Name: Default Sep 09 16:40:39.086571 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-User-Id: 208daa6413d34e4496e278fb3fc251a5 Sep 09 16:40:39.086571 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-User-Name: tempest-TestShelveInstance-1059815970-project Sep 09 16:40:39.086571 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: method: > Sep 09 16:40:39.086571 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: exception: Instance 9bed6256-fc6f-40dd-b465-54981581a6aa could not be found. Sep 09 16:40:39.086571 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: action_args: {'id': '9bed6256-fc6f-40dd-b465-54981581a6aa'} Sep 09 16:40:39.087988 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 16:40:39.087988 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:40:39.087988 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 16:40:39.087988 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 16:40:39.087988 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 16:40:39.087988 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 16:40:39.087988 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 16:40:39.087988 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 16:40:39.087988 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 16:40:39.087988 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 16:40:39.087988 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9bed6256-fc6f-40dd-b465-54981581a6aa could not be found. Sep 09 16:40:39.087988 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Sep 09 16:40:39.087988 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 16:40:39.087988 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Sep 09 16:40:39.087988 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:40:39.087988 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 16:40:39.087988 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 16:40:39.087988 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 16:40:39.087988 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 16:40:39.087988 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 16:40:39.089334 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 16:40:39.089334 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 16:40:39.089334 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 16:40:39.089334 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 16:40:39.089334 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 16:40:39.089334 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 16:40:39.089334 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 16:40:39.089334 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9bed6256-fc6f-40dd-b465-54981581a6aa could not be found. Sep 09 16:40:39.089334 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Sep 09 16:40:39.089334 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 16:40:39.089334 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Sep 09 16:40:39.089334 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:40:39.089334 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 16:40:39.089334 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 16:40:39.089334 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 16:40:39.089334 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 16:40:39.089334 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9bed6256-fc6f-40dd-b465-54981581a6aa could not be found. Sep 09 16:40:39.089334 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Sep 09 16:40:39.090549 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-7f2ee0a3-84a9-4645-9ab9-84255d9175f3 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Returning 404 to user: Instance 9bed6256-fc6f-40dd-b465-54981581a6aa could not be found. {{(pid=127196) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 16:40:39.090549 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-7f2ee0a3-84a9-4645-9ab9-84255d9175f3 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] 10.222.0.23 "GET /compute/v2.1/servers/9bed6256-fc6f-40dd-b465-54981581a6aa" status: 404 len: 111 microversion: 2.1 time: 0.043504 Sep 09 16:40:39.090549 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 496/1003] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:40:39 2022] GET /compute/v2.1/servers/9bed6256-fc6f-40dd-b465-54981581a6aa => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 16:40:39.261556 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-8b131513-35ca-4a1b-baab-c2dcf6f03542 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] Calling method '.version_select at 0x7f24fb7bea60>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:40:39.291044 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-8b131513-35ca-4a1b-baab-c2dcf6f03542 tempest-TestShelveInstance-1059815970 tempest-TestShelveInstance-1059815970-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1912061220" status: 202 len: 0 microversion: 2.1 time: 0.034876 Sep 09 16:40:39.291747 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 508/1004] 10.222.0.23 () {58 vars in 1254 bytes} [Fri Sep 9 16:40:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1912061220 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 16:41:15.934903 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-ad5ec02c-de2e-4a28-9f97-3ba31ed2e2dc tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-2081141359"}} {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:41:15.935523 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-ad5ec02c-de2e-4a28-9f97-3ba31ed2e2dc tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] [instance: 667d78d5-e585-4ce5-a240-797cf2202816] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:41:15.937473 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG dbcounter [-] [127196] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:41:15.938102 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG dbcounter [-] [127196] Writing DB stats nova_api:SELECT=1 {{(pid=127196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:41:15.944371 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-ad5ec02c-de2e-4a28-9f97-3ba31ed2e2dc tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:41:15.944860 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-ad5ec02c-de2e-4a28-9f97-3ba31ed2e2dc tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:41:15.945317 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-ad5ec02c-de2e-4a28-9f97-3ba31ed2e2dc tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:41:15.946022 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-ad5ec02c-de2e-4a28-9f97-3ba31ed2e2dc tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:41:15.946468 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-ad5ec02c-de2e-4a28-9f97-3ba31ed2e2dc tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:41:15.946913 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-ad5ec02c-de2e-4a28-9f97-3ba31ed2e2dc tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:41:16.092209 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.network.security_group_api [None req-ad5ec02c-de2e-4a28-9f97-3ba31ed2e2dc tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Removing security group 56a2ecc4-8a6e-4ba2-ae92-a5ae0df70da1 from port 5d5ee3f8-848f-4ebf-b6d0-9b071a89552e Sep 09 16:41:16.406852 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-ad5ec02c-de2e-4a28-9f97-3ba31ed2e2dc tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] 10.222.0.23 "POST /compute/v2.1/servers/667d78d5-e585-4ce5-a240-797cf2202816/action" status: 202 len: 0 microversion: 2.1 time: 0.476153 Sep 09 16:41:16.407644 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 497/1005] 10.222.0.23 () {60 vars in 1278 bytes} [Fri Sep 9 16:41:15 2022] POST /compute/v2.1/servers/667d78d5-e585-4ce5-a240-797cf2202816/action => generated 0 bytes in 478 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 16:41:16.421047 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [req-163b3a9f-d81a-4324-9427-e5324d44896e req-5736ca4e-3663-4f23-9eb2-80a69e17be36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "667d78d5-e585-4ce5-a240-797cf2202816", "tag": "5d5ee3f8-848f-4ebf-b6d0-9b071a89552e"}]} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:41:16.433062 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:41:16.434964 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:41:16.440661 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-163b3a9f-d81a-4324-9427-e5324d44896e req-5736ca4e-3663-4f23-9eb2-80a69e17be36 service nova] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:41:16.441488 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-163b3a9f-d81a-4324-9427-e5324d44896e req-5736ca4e-3663-4f23-9eb2-80a69e17be36 service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:41:16.443193 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-163b3a9f-d81a-4324-9427-e5324d44896e req-5736ca4e-3663-4f23-9eb2-80a69e17be36 service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:41:16.462014 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.compute.server_external_events [req-163b3a9f-d81a-4324-9427-e5324d44896e req-5736ca4e-3663-4f23-9eb2-80a69e17be36 service nova] Creating event network-changed:5d5ee3f8-848f-4ebf-b6d0-9b071a89552e for instance 667d78d5-e585-4ce5-a240-797cf2202816 on hv-cinder-83124 Sep 09 16:41:16.470634 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [req-163b3a9f-d81a-4324-9427-e5324d44896e req-5736ca4e-3663-4f23-9eb2-80a69e17be36 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053511 Sep 09 16:41:16.471746 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 509/1006] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Sep 9 16:41:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:41:17.453332 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-f0b2485c-87df-43ac-aaea-d1fd77a65f5b tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:41:17.453884 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-f0b2485c-87df-43ac-aaea-d1fd77a65f5b tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] [instance: 667d78d5-e585-4ce5-a240-797cf2202816] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:41:17.455680 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [req-fc6502b9-7447-4655-8e0a-365c077d8b92 req-2638acd6-f423-4327-8510-9d1e5485b9ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "667d78d5-e585-4ce5-a240-797cf2202816", "tag": "5d5ee3f8-848f-4ebf-b6d0-9b071a89552e"}]} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:41:17.460063 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f0b2485c-87df-43ac-aaea-d1fd77a65f5b tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:41:17.460823 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f0b2485c-87df-43ac-aaea-d1fd77a65f5b tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:41:17.461483 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f0b2485c-87df-43ac-aaea-d1fd77a65f5b tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:41:17.462124 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f0b2485c-87df-43ac-aaea-d1fd77a65f5b tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:41:17.462588 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f0b2485c-87df-43ac-aaea-d1fd77a65f5b tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:41:17.463270 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-f0b2485c-87df-43ac-aaea-d1fd77a65f5b tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:41:17.466982 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-fc6502b9-7447-4655-8e0a-365c077d8b92 req-2638acd6-f423-4327-8510-9d1e5485b9ef service nova] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:41:17.467574 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-fc6502b9-7447-4655-8e0a-365c077d8b92 req-2638acd6-f423-4327-8510-9d1e5485b9ef service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:41:17.468090 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-fc6502b9-7447-4655-8e0a-365c077d8b92 req-2638acd6-f423-4327-8510-9d1e5485b9ef service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:41:17.479968 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.compute.server_external_events [req-fc6502b9-7447-4655-8e0a-365c077d8b92 req-2638acd6-f423-4327-8510-9d1e5485b9ef service nova] Creating event network-changed:5d5ee3f8-848f-4ebf-b6d0-9b071a89552e for instance 667d78d5-e585-4ce5-a240-797cf2202816 on hv-cinder-83124 Sep 09 16:41:17.485051 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [req-fc6502b9-7447-4655-8e0a-365c077d8b92 req-2638acd6-f423-4327-8510-9d1e5485b9ef service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034145 Sep 09 16:41:17.485735 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 510/1007] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Sep 9 16:41:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 16:41:17.550293 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.objects.instance [None req-f0b2485c-87df-43ac-aaea-d1fd77a65f5b tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lazy-loading 'services' on Instance uuid 667d78d5-e585-4ce5-a240-797cf2202816 {{(pid=127196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 16:41:17.636157 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-f0b2485c-87df-43ac-aaea-d1fd77a65f5b tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] 10.222.0.23 "DELETE /compute/v2.1/servers/667d78d5-e585-4ce5-a240-797cf2202816/os-volume_attachments/5e6c7b83-a2e0-4e92-a828-b5ca6a302ed2" status: 202 len: 0 microversion: 2.1 time: 0.187355 Sep 09 16:41:17.640360 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 498/1008] 10.222.0.23 () {58 vars in 1416 bytes} [Fri Sep 9 16:41:17 2022] DELETE /compute/v2.1/servers/667d78d5-e585-4ce5-a240-797cf2202816/os-volume_attachments/5e6c7b83-a2e0-4e92-a828-b5ca6a302ed2 => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 16:41:17.646197 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-b2395559-5baf-4b20-ba97-6a3869c7b266 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:41:17.648496 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-b2395559-5baf-4b20-ba97-6a3869c7b266 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] [instance: 667d78d5-e585-4ce5-a240-797cf2202816] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:41:17.656683 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b2395559-5baf-4b20-ba97-6a3869c7b266 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:41:17.657417 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b2395559-5baf-4b20-ba97-6a3869c7b266 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:41:17.658045 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b2395559-5baf-4b20-ba97-6a3869c7b266 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:41:17.659367 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b2395559-5baf-4b20-ba97-6a3869c7b266 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:41:17.659959 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b2395559-5baf-4b20-ba97-6a3869c7b266 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:41:17.660679 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b2395559-5baf-4b20-ba97-6a3869c7b266 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:41:17.696699 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-b2395559-5baf-4b20-ba97-6a3869c7b266 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] 10.222.0.23 "GET /compute/v2.1/servers/667d78d5-e585-4ce5-a240-797cf2202816/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054768 Sep 09 16:41:17.702122 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 511/1009] 10.222.0.23 () {58 vars in 1302 bytes} [Fri Sep 9 16:41:17 2022] GET /compute/v2.1/servers/667d78d5-e585-4ce5-a240-797cf2202816/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 16:41:18.715795 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-a93afb5b-9683-4458-83f7-20944223a2e0 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:41:18.719543 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-a93afb5b-9683-4458-83f7-20944223a2e0 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] [instance: 667d78d5-e585-4ce5-a240-797cf2202816] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:41:18.729582 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-a93afb5b-9683-4458-83f7-20944223a2e0 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:41:18.730104 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-a93afb5b-9683-4458-83f7-20944223a2e0 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:41:18.730609 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-a93afb5b-9683-4458-83f7-20944223a2e0 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:41:18.731261 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-a93afb5b-9683-4458-83f7-20944223a2e0 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:41:18.731716 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-a93afb5b-9683-4458-83f7-20944223a2e0 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:41:18.732142 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-a93afb5b-9683-4458-83f7-20944223a2e0 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:41:18.761364 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-a93afb5b-9683-4458-83f7-20944223a2e0 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] 10.222.0.23 "GET /compute/v2.1/servers/667d78d5-e585-4ce5-a240-797cf2202816/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053966 Sep 09 16:41:18.761922 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 499/1010] 10.222.0.23 () {58 vars in 1302 bytes} [Fri Sep 9 16:41:18 2022] GET /compute/v2.1/servers/667d78d5-e585-4ce5-a240-797cf2202816/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 09 16:41:18.773074 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-4e087e00-b1d4-4ecc-9434-dbd5dd488b62 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:41:18.773571 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-4e087e00-b1d4-4ecc-9434-dbd5dd488b62 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] [instance: 667d78d5-e585-4ce5-a240-797cf2202816] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:41:18.780494 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4e087e00-b1d4-4ecc-9434-dbd5dd488b62 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:41:18.780981 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4e087e00-b1d4-4ecc-9434-dbd5dd488b62 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:41:18.781414 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4e087e00-b1d4-4ecc-9434-dbd5dd488b62 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:41:18.782095 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4e087e00-b1d4-4ecc-9434-dbd5dd488b62 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:41:18.782543 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4e087e00-b1d4-4ecc-9434-dbd5dd488b62 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:41:18.782991 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4e087e00-b1d4-4ecc-9434-dbd5dd488b62 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:41:18.861296 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.wsgi [None req-4e087e00-b1d4-4ecc-9434-dbd5dd488b62 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] HTTP exception thrown: Instance 667d78d5-e585-4ce5-a240-797cf2202816 is not attached to volume 5e6c7b83-a2e0-4e92-a828-b5ca6a302ed2 Sep 09 16:41:18.863642 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-4e087e00-b1d4-4ecc-9434-dbd5dd488b62 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Request method failure captured: Sep 09 16:41:18.863642 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: request: DELETE /compute/v2.1/servers/667d78d5-e585-4ce5-a240-797cf2202816/os-volume_attachments/5e6c7b83-a2e0-4e92-a828-b5ca6a302ed2 HTTP/1.1 Sep 09 16:41:18.863642 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Accept: application/json Sep 09 16:41:18.863642 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Accept-Encoding: identity Sep 09 16:41:18.863642 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Connection: close Sep 09 16:41:18.863642 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Content-Length: 0 Sep 09 16:41:18.863642 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Content-Type: application/json Sep 09 16:41:18.863642 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Host: 10.222.0.23 Sep 09 16:41:18.863642 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Openstack-System-Scope: None Sep 09 16:41:18.863642 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: User-Agent: python-urllib3/1.26.12 Sep 09 16:41:18.863642 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Auth-Token: gAAAAABjG2whPuO1G6ZYcywRy0LMzf_i5CwSKeMmTN2tP9d6TW9KK91Wqotg8le7Ly6tZ5SIIpysaXgrxc53gX_l6UxY0wcsiRA23fz66YnXcY6ZGHZNPhSvnfiIlqR9wdLaEPoLQl0vEU29kyaGRJewrIhIKMSh2OV7TWjPUod2YcI8KIL0CsU Sep 09 16:41:18.863642 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Domain-Id: None Sep 09 16:41:18.863642 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Domain-Name: None Sep 09 16:41:18.863642 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Identity-Status: Confirmed Sep 09 16:41:18.863642 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Is-Admin-Project: True Sep 09 16:41:18.863642 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Project-Domain-Id: default Sep 09 16:41:18.863642 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Project-Domain-Name: Default Sep 09 16:41:18.863642 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Project-Id: ff5daf9e9245447dac44278ce813b4a0 Sep 09 16:41:18.863642 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Project-Name: tempest-TestMinimumBasicScenario-659667804 Sep 09 16:41:18.863642 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Role: member,reader Sep 09 16:41:18.863642 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Roles: member,reader Sep 09 16:41:18.865282 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ff5daf9e9245447dac44278ce813b4a0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ff5daf9e9245447dac44278ce813b4a0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ff5daf9e9245447dac44278ce813b4a0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ff5daf9e9245447dac44278ce813b4a0"}]}] Sep 09 16:41:18.865282 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Tenant: tempest-TestMinimumBasicScenario-659667804 Sep 09 16:41:18.865282 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Tenant-Id: ff5daf9e9245447dac44278ce813b4a0 Sep 09 16:41:18.865282 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Tenant-Name: tempest-TestMinimumBasicScenario-659667804 Sep 09 16:41:18.865282 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User: tempest-TestMinimumBasicScenario-659667804-project Sep 09 16:41:18.865282 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User-Domain-Id: default Sep 09 16:41:18.865282 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User-Domain-Name: Default Sep 09 16:41:18.865282 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User-Id: f86d1ec821814f628879590513702cec Sep 09 16:41:18.865282 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User-Name: tempest-TestMinimumBasicScenario-659667804-project Sep 09 16:41:18.865282 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: method: > Sep 09 16:41:18.865282 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: exception: Instance 667d78d5-e585-4ce5-a240-797cf2202816 is not attached to volume 5e6c7b83-a2e0-4e92-a828-b5ca6a302ed2 Sep 09 16:41:18.866346 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: action_args: {'server_id': '667d78d5-e585-4ce5-a240-797cf2202816', 'id': '5e6c7b83-a2e0-4e92-a828-b5ca6a302ed2'} Sep 09 16:41:18.866346 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 16:41:18.866346 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:41:18.866346 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 09 16:41:18.866346 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 09 16:41:18.866346 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 09 16:41:18.866346 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 09 16:41:18.866346 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 09 16:41:18.866346 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 09 16:41:18.866346 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 5e6c7b83-a2e0-4e92-a828-b5ca6a302ed2. Sep 09 16:41:18.866346 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:41:18.866346 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 16:41:18.866346 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:41:18.866346 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:41:18.866346 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 16:41:18.866346 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 16:41:18.866346 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 16:41:18.866346 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 16:41:18.866346 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 16:41:18.867880 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 16:41:18.867880 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 09 16:41:18.867880 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 09 16:41:18.867880 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 667d78d5-e585-4ce5-a240-797cf2202816 is not attached to volume 5e6c7b83-a2e0-4e92-a828-b5ca6a302ed2 Sep 09 16:41:18.867880 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:41:18.867880 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 16:41:18.867880 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:41:18.867880 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:41:18.867880 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 16:41:18.867880 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 16:41:18.867880 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 16:41:18.867880 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 16:41:18.867880 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 667d78d5-e585-4ce5-a240-797cf2202816 is not attached to volume 5e6c7b83-a2e0-4e92-a828-b5ca6a302ed2 Sep 09 16:41:18.867880 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:41:18.867880 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-4e087e00-b1d4-4ecc-9434-dbd5dd488b62 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Returning 404 to user: Instance 667d78d5-e585-4ce5-a240-797cf2202816 is not attached to volume 5e6c7b83-a2e0-4e92-a828-b5ca6a302ed2 {{(pid=127198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 16:41:18.869207 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-4e087e00-b1d4-4ecc-9434-dbd5dd488b62 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] 10.222.0.23 "DELETE /compute/v2.1/servers/667d78d5-e585-4ce5-a240-797cf2202816/os-volume_attachments/5e6c7b83-a2e0-4e92-a828-b5ca6a302ed2" status: 404 len: 154 microversion: 2.1 time: 0.096139 Sep 09 16:41:18.869207 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 512/1011] 10.222.0.23 () {58 vars in 1416 bytes} [Fri Sep 9 16:41:18 2022] DELETE /compute/v2.1/servers/667d78d5-e585-4ce5-a240-797cf2202816/os-volume_attachments/5e6c7b83-a2e0-4e92-a828-b5ca6a302ed2 => generated 154 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 16:41:20.013562 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-a2c5474e-c1ea-4478-8654-cb29480f1469 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:41:20.014077 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-a2c5474e-c1ea-4478-8654-cb29480f1469 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] [instance: 667d78d5-e585-4ce5-a240-797cf2202816] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:41:20.020880 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-a2c5474e-c1ea-4478-8654-cb29480f1469 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:41:20.021364 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-a2c5474e-c1ea-4478-8654-cb29480f1469 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:41:20.021798 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-a2c5474e-c1ea-4478-8654-cb29480f1469 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:41:20.022491 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-a2c5474e-c1ea-4478-8654-cb29480f1469 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:41:20.022986 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-a2c5474e-c1ea-4478-8654-cb29480f1469 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:41:20.023409 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-a2c5474e-c1ea-4478-8654-cb29480f1469 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:41:20.048609 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-a2c5474e-c1ea-4478-8654-cb29480f1469 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] [instance: 667d78d5-e585-4ce5-a240-797cf2202816] Going to try to terminate instance {{(pid=127196) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 16:41:20.126198 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-a2c5474e-c1ea-4478-8654-cb29480f1469 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] 10.222.0.23 "DELETE /compute/v2.1/servers/667d78d5-e585-4ce5-a240-797cf2202816" status: 204 len: 0 microversion: 2.1 time: 0.116053 Sep 09 16:41:20.126806 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 500/1012] 10.222.0.23 () {58 vars in 1239 bytes} [Fri Sep 9 16:41:20 2022] DELETE /compute/v2.1/servers/667d78d5-e585-4ce5-a240-797cf2202816 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 16:41:20.135389 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-d01ba5bf-3efc-41d7-9a83-8cf677864a96 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:41:20.136000 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-d01ba5bf-3efc-41d7-9a83-8cf677864a96 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] [instance: 667d78d5-e585-4ce5-a240-797cf2202816] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:41:20.142356 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d01ba5bf-3efc-41d7-9a83-8cf677864a96 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:41:20.142869 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d01ba5bf-3efc-41d7-9a83-8cf677864a96 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:41:20.143300 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d01ba5bf-3efc-41d7-9a83-8cf677864a96 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:41:20.143987 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d01ba5bf-3efc-41d7-9a83-8cf677864a96 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:41:20.144434 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d01ba5bf-3efc-41d7-9a83-8cf677864a96 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:41:20.144855 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d01ba5bf-3efc-41d7-9a83-8cf677864a96 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:41:20.279918 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-d01ba5bf-3efc-41d7-9a83-8cf677864a96 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86d1ec821814f628879590513702cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5daf9e9245447dac44278ce813b4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:41:20.290301 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-d01ba5bf-3efc-41d7-9a83-8cf677864a96 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] 10.222.0.23 "GET /compute/v2.1/servers/667d78d5-e585-4ce5-a240-797cf2202816" status: 200 len: 1553 microversion: 2.1 time: 0.158703 Sep 09 16:41:20.291306 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 513/1013] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:41:20 2022] GET /compute/v2.1/servers/667d78d5-e585-4ce5-a240-797cf2202816 => generated 1553 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:41:21.319214 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-92fb974d-4fc1-4cea-93d4-fc9593a2d961 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:41:21.320396 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-92fb974d-4fc1-4cea-93d4-fc9593a2d961 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] [instance: 667d78d5-e585-4ce5-a240-797cf2202816] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:41:21.331048 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-92fb974d-4fc1-4cea-93d4-fc9593a2d961 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:41:21.331800 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-92fb974d-4fc1-4cea-93d4-fc9593a2d961 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:41:21.332525 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-92fb974d-4fc1-4cea-93d4-fc9593a2d961 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:41:21.333719 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-92fb974d-4fc1-4cea-93d4-fc9593a2d961 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:41:21.334477 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-92fb974d-4fc1-4cea-93d4-fc9593a2d961 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:41:21.335224 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-92fb974d-4fc1-4cea-93d4-fc9593a2d961 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:41:21.469194 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-92fb974d-4fc1-4cea-93d4-fc9593a2d961 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86d1ec821814f628879590513702cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5daf9e9245447dac44278ce813b4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:41:21.477576 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-92fb974d-4fc1-4cea-93d4-fc9593a2d961 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] 10.222.0.23 "GET /compute/v2.1/servers/667d78d5-e585-4ce5-a240-797cf2202816" status: 200 len: 1553 microversion: 2.1 time: 0.165736 Sep 09 16:41:21.478121 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 501/1014] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:41:21 2022] GET /compute/v2.1/servers/667d78d5-e585-4ce5-a240-797cf2202816 => generated 1553 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:41:22.242522 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [req-6528c14a-6654-4081-8507-1e17698411e5 req-2eb1d589-5d1a-455b-9584-a0732577032e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "667d78d5-e585-4ce5-a240-797cf2202816", "name": "network-vif-deleted", "tag": "5d5ee3f8-848f-4ebf-b6d0-9b071a89552e"}]} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:41:22.254700 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-6528c14a-6654-4081-8507-1e17698411e5 req-2eb1d589-5d1a-455b-9584-a0732577032e service nova] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:41:22.255171 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-6528c14a-6654-4081-8507-1e17698411e5 req-2eb1d589-5d1a-455b-9584-a0732577032e service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:41:22.255691 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-6528c14a-6654-4081-8507-1e17698411e5 req-2eb1d589-5d1a-455b-9584-a0732577032e service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:41:22.267803 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.compute.server_external_events [req-6528c14a-6654-4081-8507-1e17698411e5 req-2eb1d589-5d1a-455b-9584-a0732577032e service nova] Creating event network-vif-deleted:5d5ee3f8-848f-4ebf-b6d0-9b071a89552e for instance 667d78d5-e585-4ce5-a240-797cf2202816 on hv-cinder-83124 Sep 09 16:41:22.273605 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [req-6528c14a-6654-4081-8507-1e17698411e5 req-2eb1d589-5d1a-455b-9584-a0732577032e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034841 Sep 09 16:41:22.274412 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 514/1015] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Sep 9 16:41:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:41:22.505135 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-4863c96c-568f-4ba9-b92a-7f3ef15dbcb1 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:41:22.505939 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-4863c96c-568f-4ba9-b92a-7f3ef15dbcb1 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] [instance: 667d78d5-e585-4ce5-a240-797cf2202816] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:41:22.514742 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-4863c96c-568f-4ba9-b92a-7f3ef15dbcb1 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:41:22.515226 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-4863c96c-568f-4ba9-b92a-7f3ef15dbcb1 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:41:22.515653 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-4863c96c-568f-4ba9-b92a-7f3ef15dbcb1 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:41:22.516374 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-4863c96c-568f-4ba9-b92a-7f3ef15dbcb1 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:41:22.516826 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-4863c96c-568f-4ba9-b92a-7f3ef15dbcb1 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:41:22.517240 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-4863c96c-568f-4ba9-b92a-7f3ef15dbcb1 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:41:22.552367 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-4863c96c-568f-4ba9-b92a-7f3ef15dbcb1 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:41:22.552771 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-4863c96c-568f-4ba9-b92a-7f3ef15dbcb1 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:41:22.553193 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-4863c96c-568f-4ba9-b92a-7f3ef15dbcb1 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:41:22.553635 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.objects.instance [None req-4863c96c-568f-4ba9-b92a-7f3ef15dbcb1 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lazy-loading 'fault' on Instance uuid 667d78d5-e585-4ce5-a240-797cf2202816 {{(pid=127196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 16:41:22.598313 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-4863c96c-568f-4ba9-b92a-7f3ef15dbcb1 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86d1ec821814f628879590513702cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5daf9e9245447dac44278ce813b4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:41:22.606980 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-4863c96c-568f-4ba9-b92a-7f3ef15dbcb1 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] 10.222.0.23 "GET /compute/v2.1/servers/667d78d5-e585-4ce5-a240-797cf2202816" status: 200 len: 1348 microversion: 2.1 time: 0.108463 Sep 09 16:41:22.608079 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 502/1016] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:41:22 2022] GET /compute/v2.1/servers/667d78d5-e585-4ce5-a240-797cf2202816 => generated 1348 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:41:23.640346 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-b50d8b89-bb47-48c7-b743-7877904f2227 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:41:23.645606 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-b50d8b89-bb47-48c7-b743-7877904f2227 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] [instance: 667d78d5-e585-4ce5-a240-797cf2202816] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:41:23.657541 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b50d8b89-bb47-48c7-b743-7877904f2227 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:41:23.658027 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b50d8b89-bb47-48c7-b743-7877904f2227 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:41:23.658871 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b50d8b89-bb47-48c7-b743-7877904f2227 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:41:23.659580 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b50d8b89-bb47-48c7-b743-7877904f2227 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:41:23.660032 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b50d8b89-bb47-48c7-b743-7877904f2227 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:41:23.660454 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b50d8b89-bb47-48c7-b743-7877904f2227 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:41:23.676057 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.wsgi [None req-b50d8b89-bb47-48c7-b743-7877904f2227 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] HTTP exception thrown: Instance 667d78d5-e585-4ce5-a240-797cf2202816 could not be found. Sep 09 16:41:23.678544 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-b50d8b89-bb47-48c7-b743-7877904f2227 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Request method failure captured: Sep 09 16:41:23.678544 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: request: GET /compute/v2.1/servers/667d78d5-e585-4ce5-a240-797cf2202816 HTTP/1.1 Sep 09 16:41:23.678544 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Accept: application/json Sep 09 16:41:23.678544 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Accept-Encoding: identity Sep 09 16:41:23.678544 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Connection: close Sep 09 16:41:23.678544 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Content-Length: 0 Sep 09 16:41:23.678544 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Content-Type: application/json Sep 09 16:41:23.678544 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Host: 10.222.0.23 Sep 09 16:41:23.678544 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Openstack-System-Scope: None Sep 09 16:41:23.678544 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: User-Agent: python-urllib3/1.26.12 Sep 09 16:41:23.678544 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Auth-Token: gAAAAABjG2whPuO1G6ZYcywRy0LMzf_i5CwSKeMmTN2tP9d6TW9KK91Wqotg8le7Ly6tZ5SIIpysaXgrxc53gX_l6UxY0wcsiRA23fz66YnXcY6ZGHZNPhSvnfiIlqR9wdLaEPoLQl0vEU29kyaGRJewrIhIKMSh2OV7TWjPUod2YcI8KIL0CsU Sep 09 16:41:23.678544 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Domain-Id: None Sep 09 16:41:23.678544 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Domain-Name: None Sep 09 16:41:23.678544 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Identity-Status: Confirmed Sep 09 16:41:23.678544 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Is-Admin-Project: True Sep 09 16:41:23.678544 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Project-Domain-Id: default Sep 09 16:41:23.678544 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Project-Domain-Name: Default Sep 09 16:41:23.678544 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Project-Id: ff5daf9e9245447dac44278ce813b4a0 Sep 09 16:41:23.678544 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Project-Name: tempest-TestMinimumBasicScenario-659667804 Sep 09 16:41:23.678544 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Role: member,reader Sep 09 16:41:23.678544 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Roles: member,reader Sep 09 16:41:23.679951 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ff5daf9e9245447dac44278ce813b4a0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ff5daf9e9245447dac44278ce813b4a0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ff5daf9e9245447dac44278ce813b4a0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ff5daf9e9245447dac44278ce813b4a0"}]}] Sep 09 16:41:23.679951 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Tenant: tempest-TestMinimumBasicScenario-659667804 Sep 09 16:41:23.679951 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Tenant-Id: ff5daf9e9245447dac44278ce813b4a0 Sep 09 16:41:23.679951 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Tenant-Name: tempest-TestMinimumBasicScenario-659667804 Sep 09 16:41:23.679951 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User: tempest-TestMinimumBasicScenario-659667804-project Sep 09 16:41:23.679951 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User-Domain-Id: default Sep 09 16:41:23.679951 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User-Domain-Name: Default Sep 09 16:41:23.679951 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User-Id: f86d1ec821814f628879590513702cec Sep 09 16:41:23.679951 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User-Name: tempest-TestMinimumBasicScenario-659667804-project Sep 09 16:41:23.679951 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: method: > Sep 09 16:41:23.679951 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: exception: Instance 667d78d5-e585-4ce5-a240-797cf2202816 could not be found. Sep 09 16:41:23.679951 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: action_args: {'id': '667d78d5-e585-4ce5-a240-797cf2202816'} Sep 09 16:41:23.680759 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 16:41:23.680759 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:41:23.680759 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 16:41:23.680759 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 16:41:23.680759 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 16:41:23.680759 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 16:41:23.680759 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 16:41:23.680759 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 16:41:23.680759 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 16:41:23.680759 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 16:41:23.680759 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 667d78d5-e585-4ce5-a240-797cf2202816 could not be found. Sep 09 16:41:23.680759 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:41:23.680759 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 16:41:23.680759 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:41:23.680759 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:41:23.680759 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 16:41:23.680759 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 16:41:23.680759 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 16:41:23.680759 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 16:41:23.680759 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 16:41:23.682119 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 16:41:23.682119 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 16:41:23.682119 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 16:41:23.682119 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 16:41:23.682119 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 16:41:23.682119 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 16:41:23.682119 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 16:41:23.682119 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 667d78d5-e585-4ce5-a240-797cf2202816 could not be found. Sep 09 16:41:23.682119 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:41:23.682119 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 16:41:23.682119 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:41:23.682119 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:41:23.682119 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 16:41:23.682119 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 16:41:23.682119 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 16:41:23.682119 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 16:41:23.682119 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 667d78d5-e585-4ce5-a240-797cf2202816 could not be found. Sep 09 16:41:23.682119 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:41:23.683601 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-b50d8b89-bb47-48c7-b743-7877904f2227 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Returning 404 to user: Instance 667d78d5-e585-4ce5-a240-797cf2202816 could not be found. {{(pid=127198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 16:41:23.683601 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-b50d8b89-bb47-48c7-b743-7877904f2227 tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] 10.222.0.23 "GET /compute/v2.1/servers/667d78d5-e585-4ce5-a240-797cf2202816" status: 404 len: 111 microversion: 2.1 time: 0.052116 Sep 09 16:41:23.683601 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 515/1017] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:41:23 2022] GET /compute/v2.1/servers/667d78d5-e585-4ce5-a240-797cf2202816 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 16:41:23.690615 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-965ce475-46e2-410d-a40f-2e613432d82b tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] Calling method '.version_select at 0x7f24fb6001f0>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:41:23.714625 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-965ce475-46e2-410d-a40f-2e613432d82b tempest-TestMinimumBasicScenario-659667804 tempest-TestMinimumBasicScenario-659667804-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-172403749" status: 202 len: 0 microversion: 2.1 time: 0.027842 Sep 09 16:41:23.715197 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 503/1018] 10.222.0.23 () {58 vars in 1269 bytes} [Fri Sep 9 16:41:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-172403749 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 16:41:41.399897 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_api:SELECT=14 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:41:41.401293 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell1:SELECT=26 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:41:41.592771 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-2833108a-e063-46e8-b1f0-4fe8d564158e tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Action: 'create', calling method: .version_select at 0x7f24fb509a60>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-471889667", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI2IO5XoTpzUiz0aY1PcGJ3PJPHG20sZGUxbrCV9p3FxTcP0GQFl/Ib49MW1bJeq9J2ER6IAn33SCQokzmQKv7uCeN+EQEn4T+d4UIH+VY1PHcNoss0NJr0anYc7Wg0Ijg=="}} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:41:41.608194 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.quota [None req-2833108a-e063-46e8-b1f0-4fe8d564158e tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Getting quotas for project 5c52563210cf435696f3e3ae3907b0fb. Resources: {'key_pairs'} {{(pid=127198) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 16:41:41.611971 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.quota [None req-2833108a-e063-46e8-b1f0-4fe8d564158e tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Getting quotas for user 69ec3d4f006c4f8f815b0cad9f933208 and project 5c52563210cf435696f3e3ae3907b0fb. Resources: {'key_pairs'} {{(pid=127198) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 16:41:41.635329 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-2833108a-e063-46e8-b1f0-4fe8d564158e tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.240640 Sep 09 16:41:41.641890 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 516/1019] 10.222.0.23 () {60 vars in 1159 bytes} [Fri Sep 9 16:41:41 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:41:56.929290 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG dbcounter [-] [127196] Writing DB stats nova_cell1:SELECT=47,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:41:56.930235 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG dbcounter [-] [127196] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:41:56.935937 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-c6c2c28e-fb28-45f7-8ebf-b055723df603 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1356457198", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-471889667", "security_groups": [{"name": "tempest-secgroup-smoke-336681543"}], "block_device_mapping_v2": [{"uuid": "736b6354-8dff-4909-a81b-1609b806afc5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b6e09802-a0bc-4038-92b1-56776749943b"}]}} {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:41:57.163160 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.network.neutron [None req-c6c2c28e-fb28-45f7-8ebf-b055723df603 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] validate_networks() for [('b6e09802-a0bc-4038-92b1-56776749943b', None, None, None, None, None)] {{(pid=127196) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 16:41:57.537423 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.virt.hardware [None req-c6c2c28e-fb28-45f7-8ebf-b055723df603 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Flavor limits 0:0:0 {{(pid=127196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 16:41:57.538056 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.virt.hardware [None req-c6c2c28e-fb28-45f7-8ebf-b055723df603 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Image limits 0:0:0 {{(pid=127196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 16:41:57.538876 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.virt.hardware [None req-c6c2c28e-fb28-45f7-8ebf-b055723df603 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Flavor pref 0:0:0 {{(pid=127196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 16:41:57.539382 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.virt.hardware [None req-c6c2c28e-fb28-45f7-8ebf-b055723df603 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Image pref 0:0:0 {{(pid=127196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 16:41:57.539991 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.virt.hardware [None req-c6c2c28e-fb28-45f7-8ebf-b055723df603 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 16:41:57.551093 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-c6c2c28e-fb28-45f7-8ebf-b055723df603 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:41:57.551578 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-c6c2c28e-fb28-45f7-8ebf-b055723df603 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:41:57.552016 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-c6c2c28e-fb28-45f7-8ebf-b055723df603 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:41:57.552748 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-c6c2c28e-fb28-45f7-8ebf-b055723df603 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:41:57.553203 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-c6c2c28e-fb28-45f7-8ebf-b055723df603 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:41:57.553634 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-c6c2c28e-fb28-45f7-8ebf-b055723df603 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:41:57.570530 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.quota [None req-c6c2c28e-fb28-45f7-8ebf-b055723df603 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Getting quotas for project 5c52563210cf435696f3e3ae3907b0fb. Resources: {'cores', 'instances', 'ram'} {{(pid=127196) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 16:41:57.575122 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.quota [None req-c6c2c28e-fb28-45f7-8ebf-b055723df603 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Getting quotas for user 69ec3d4f006c4f8f815b0cad9f933208 and project 5c52563210cf435696f3e3ae3907b0fb. Resources: {'cores', 'instances', 'ram'} {{(pid=127196) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 16:41:57.634202 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-c6c2c28e-fb28-45f7-8ebf-b055723df603 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Going to run 1 instances... {{(pid=127196) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 16:41:57.636385 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-c6c2c28e-fb28-45f7-8ebf-b055723df603 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] [instance: d4bd5be5-501a-42aa-b8ad-4f302c5d3c77] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='736b6354-8dff-4909-a81b-1609b806afc5',volume_size=None,volume_type=None)] {{(pid=127196) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 16:41:57.764640 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR oslo.messaging._drivers.impl_rabbit [None req-c6c2c28e-fb28-45f7-8ebf-b055723df603 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] [fddef0c1-c343-4653-be18-b0fec87a32ea] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 09 16:41:58.777060 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO oslo.messaging._drivers.impl_rabbit [None req-c6c2c28e-fb28-45f7-8ebf-b055723df603 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] [fddef0c1-c343-4653-be18-b0fec87a32ea] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 58924. Sep 09 16:41:58.782904 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-c6c2c28e-fb28-45f7-8ebf-b055723df603 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.855798 Sep 09 16:41:58.783756 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 504/1020] 10.222.0.23 () {60 vars in 1147 bytes} [Fri Sep 9 16:41:56 2022] POST /compute/v2.1/servers => generated 405 bytes in 1858 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 16:41:58.792785 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell0:SELECT=4 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:41:58.793549 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:41:58.797601 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-8b230d7d-8584-490e-8c04-f3b90b72253b tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:41:58.798531 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-8b230d7d-8584-490e-8c04-f3b90b72253b tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] [instance: d4bd5be5-501a-42aa-b8ad-4f302c5d3c77] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:41:58.953339 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-8b230d7d-8584-490e-8c04-f3b90b72253b tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ec3d4f006c4f8f815b0cad9f933208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c52563210cf435696f3e3ae3907b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:41:58.960621 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-8b230d7d-8584-490e-8c04-f3b90b72253b tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] 10.222.0.23 "GET /compute/v2.1/servers/d4bd5be5-501a-42aa-b8ad-4f302c5d3c77" status: 200 len: 1094 microversion: 2.1 time: 0.169210 Sep 09 16:41:58.961313 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 517/1021] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:41:58 2022] GET /compute/v2.1/servers/d4bd5be5-501a-42aa-b8ad-4f302c5d3c77 => generated 1094 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:41:59.985230 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-fc854c3d-6cc6-4e80-9fb4-e1641fb9cc42 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:41:59.985992 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-fc854c3d-6cc6-4e80-9fb4-e1641fb9cc42 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] [instance: d4bd5be5-501a-42aa-b8ad-4f302c5d3c77] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:41:59.992707 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-fc854c3d-6cc6-4e80-9fb4-e1641fb9cc42 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:41:59.993293 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-fc854c3d-6cc6-4e80-9fb4-e1641fb9cc42 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:41:59.993795 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-fc854c3d-6cc6-4e80-9fb4-e1641fb9cc42 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:41:59.994603 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-fc854c3d-6cc6-4e80-9fb4-e1641fb9cc42 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:41:59.995070 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-fc854c3d-6cc6-4e80-9fb4-e1641fb9cc42 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:41:59.995498 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-fc854c3d-6cc6-4e80-9fb4-e1641fb9cc42 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:42:00.068292 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-fc854c3d-6cc6-4e80-9fb4-e1641fb9cc42 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ec3d4f006c4f8f815b0cad9f933208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c52563210cf435696f3e3ae3907b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:42:00.086685 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-fc854c3d-6cc6-4e80-9fb4-e1641fb9cc42 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] 10.222.0.23 "GET /compute/v2.1/servers/d4bd5be5-501a-42aa-b8ad-4f302c5d3c77" status: 200 len: 1210 microversion: 2.1 time: 0.106083 Sep 09 16:42:00.088004 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 505/1022] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:41:59 2022] GET /compute/v2.1/servers/d4bd5be5-501a-42aa-b8ad-4f302c5d3c77 => generated 1210 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:42:01.109663 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-fc644fce-a41e-4d12-a5e2-48f355c54b44 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:42:01.111157 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-fc644fce-a41e-4d12-a5e2-48f355c54b44 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] [instance: d4bd5be5-501a-42aa-b8ad-4f302c5d3c77] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:42:01.117973 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fc644fce-a41e-4d12-a5e2-48f355c54b44 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:42:01.118542 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fc644fce-a41e-4d12-a5e2-48f355c54b44 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:42:01.119068 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fc644fce-a41e-4d12-a5e2-48f355c54b44 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:42:01.119825 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fc644fce-a41e-4d12-a5e2-48f355c54b44 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:42:01.120305 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fc644fce-a41e-4d12-a5e2-48f355c54b44 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:42:01.120720 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fc644fce-a41e-4d12-a5e2-48f355c54b44 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:42:01.585502 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-fc644fce-a41e-4d12-a5e2-48f355c54b44 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ec3d4f006c4f8f815b0cad9f933208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c52563210cf435696f3e3ae3907b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:42:01.593598 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-fc644fce-a41e-4d12-a5e2-48f355c54b44 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] 10.222.0.23 "GET /compute/v2.1/servers/d4bd5be5-501a-42aa-b8ad-4f302c5d3c77" status: 200 len: 1265 microversion: 2.1 time: 0.487861 Sep 09 16:42:01.594233 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 518/1023] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:42:01 2022] GET /compute/v2.1/servers/d4bd5be5-501a-42aa-b8ad-4f302c5d3c77 => generated 1265 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:42:01.683999 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [req-a897ea94-cef1-4f2f-8173-0c14e82b6fc7 req-e27becb8-7726-49f7-9413-3c8021bee98d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4bd5be5-501a-42aa-b8ad-4f302c5d3c77", "tag": "c2509bb6-b9e5-44be-b2a0-f91a4c2c58fb"}]} {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:42:01.695080 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [req-a897ea94-cef1-4f2f-8173-0c14e82b6fc7 req-e27becb8-7726-49f7-9413-3c8021bee98d service nova] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:42:01.695480 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [req-a897ea94-cef1-4f2f-8173-0c14e82b6fc7 req-e27becb8-7726-49f7-9413-3c8021bee98d service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:42:01.695907 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [req-a897ea94-cef1-4f2f-8173-0c14e82b6fc7 req-e27becb8-7726-49f7-9413-3c8021bee98d service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:42:01.707089 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.compute.server_external_events [req-a897ea94-cef1-4f2f-8173-0c14e82b6fc7 req-e27becb8-7726-49f7-9413-3c8021bee98d service nova] Creating event network-changed:c2509bb6-b9e5-44be-b2a0-f91a4c2c58fb for instance d4bd5be5-501a-42aa-b8ad-4f302c5d3c77 on hv-cinder-83124 Sep 09 16:42:01.712198 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [req-a897ea94-cef1-4f2f-8173-0c14e82b6fc7 req-e27becb8-7726-49f7-9413-3c8021bee98d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031902 Sep 09 16:42:01.713316 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 506/1024] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Sep 9 16:42:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:42:02.616086 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-022fa40c-d65d-432b-abde-b95cae8b462b tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:42:02.616639 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-022fa40c-d65d-432b-abde-b95cae8b462b tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] [instance: d4bd5be5-501a-42aa-b8ad-4f302c5d3c77] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:42:02.623423 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-022fa40c-d65d-432b-abde-b95cae8b462b tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:42:02.623909 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-022fa40c-d65d-432b-abde-b95cae8b462b tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:42:02.624336 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-022fa40c-d65d-432b-abde-b95cae8b462b tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:42:02.625014 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-022fa40c-d65d-432b-abde-b95cae8b462b tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:42:02.625475 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-022fa40c-d65d-432b-abde-b95cae8b462b tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:42:02.625878 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-022fa40c-d65d-432b-abde-b95cae8b462b tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:42:02.834368 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-022fa40c-d65d-432b-abde-b95cae8b462b tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ec3d4f006c4f8f815b0cad9f933208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c52563210cf435696f3e3ae3907b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:42:02.842762 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-022fa40c-d65d-432b-abde-b95cae8b462b tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] 10.222.0.23 "GET /compute/v2.1/servers/d4bd5be5-501a-42aa-b8ad-4f302c5d3c77" status: 200 len: 1265 microversion: 2.1 time: 0.230641 Sep 09 16:42:02.843460 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 519/1025] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:42:02 2022] GET /compute/v2.1/servers/d4bd5be5-501a-42aa-b8ad-4f302c5d3c77 => generated 1265 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:42:03.871934 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-a32ea19c-5dfa-4585-8a34-8c6442e3b612 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:42:03.873071 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-a32ea19c-5dfa-4585-8a34-8c6442e3b612 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] [instance: d4bd5be5-501a-42aa-b8ad-4f302c5d3c77] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:42:03.880543 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-a32ea19c-5dfa-4585-8a34-8c6442e3b612 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:42:03.881062 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-a32ea19c-5dfa-4585-8a34-8c6442e3b612 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:42:03.881929 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-a32ea19c-5dfa-4585-8a34-8c6442e3b612 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:42:03.882434 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-a32ea19c-5dfa-4585-8a34-8c6442e3b612 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:42:03.882664 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-a32ea19c-5dfa-4585-8a34-8c6442e3b612 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:42:03.883081 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-a32ea19c-5dfa-4585-8a34-8c6442e3b612 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:42:04.020153 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-a32ea19c-5dfa-4585-8a34-8c6442e3b612 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ec3d4f006c4f8f815b0cad9f933208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c52563210cf435696f3e3ae3907b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:42:04.028461 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-a32ea19c-5dfa-4585-8a34-8c6442e3b612 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] 10.222.0.23 "GET /compute/v2.1/servers/d4bd5be5-501a-42aa-b8ad-4f302c5d3c77" status: 200 len: 1265 microversion: 2.1 time: 0.164681 Sep 09 16:42:04.029002 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 507/1026] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:42:03 2022] GET /compute/v2.1/servers/d4bd5be5-501a-42aa-b8ad-4f302c5d3c77 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:42:05.061593 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-59204224-75eb-44d5-85f5-7806de2b0e62 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:42:05.062643 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-59204224-75eb-44d5-85f5-7806de2b0e62 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] [instance: d4bd5be5-501a-42aa-b8ad-4f302c5d3c77] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:42:05.073495 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-59204224-75eb-44d5-85f5-7806de2b0e62 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:42:05.074346 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-59204224-75eb-44d5-85f5-7806de2b0e62 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:42:05.075098 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-59204224-75eb-44d5-85f5-7806de2b0e62 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:42:05.076653 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-59204224-75eb-44d5-85f5-7806de2b0e62 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:42:05.077412 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-59204224-75eb-44d5-85f5-7806de2b0e62 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:42:05.078189 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-59204224-75eb-44d5-85f5-7806de2b0e62 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:42:05.220380 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-59204224-75eb-44d5-85f5-7806de2b0e62 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ec3d4f006c4f8f815b0cad9f933208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c52563210cf435696f3e3ae3907b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:42:05.228638 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-59204224-75eb-44d5-85f5-7806de2b0e62 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] 10.222.0.23 "GET /compute/v2.1/servers/d4bd5be5-501a-42aa-b8ad-4f302c5d3c77" status: 200 len: 1265 microversion: 2.1 time: 0.173800 Sep 09 16:42:05.229215 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 520/1027] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:42:05 2022] GET /compute/v2.1/servers/d4bd5be5-501a-42aa-b8ad-4f302c5d3c77 => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:42:06.254696 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-5eb98f91-8c26-4796-b024-a988d5ec479f tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:42:06.255519 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-5eb98f91-8c26-4796-b024-a988d5ec479f tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] [instance: d4bd5be5-501a-42aa-b8ad-4f302c5d3c77] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:42:06.262320 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-5eb98f91-8c26-4796-b024-a988d5ec479f tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:42:06.262833 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-5eb98f91-8c26-4796-b024-a988d5ec479f tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:42:06.263252 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-5eb98f91-8c26-4796-b024-a988d5ec479f tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:42:06.263960 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-5eb98f91-8c26-4796-b024-a988d5ec479f tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:42:06.264407 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-5eb98f91-8c26-4796-b024-a988d5ec479f tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:42:06.264827 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-5eb98f91-8c26-4796-b024-a988d5ec479f tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:42:06.417104 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-5eb98f91-8c26-4796-b024-a988d5ec479f tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ec3d4f006c4f8f815b0cad9f933208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c52563210cf435696f3e3ae3907b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:42:06.427449 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-5eb98f91-8c26-4796-b024-a988d5ec479f tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] 10.222.0.23 "GET /compute/v2.1/servers/d4bd5be5-501a-42aa-b8ad-4f302c5d3c77" status: 200 len: 1265 microversion: 2.1 time: 0.178108 Sep 09 16:42:06.428078 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 508/1028] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:42:06 2022] GET /compute/v2.1/servers/d4bd5be5-501a-42aa-b8ad-4f302c5d3c77 => generated 1265 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:42:07.455002 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-96348294-d287-4785-826e-19b4ee77625b tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:42:07.455678 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-96348294-d287-4785-826e-19b4ee77625b tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] [instance: d4bd5be5-501a-42aa-b8ad-4f302c5d3c77] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:42:07.463562 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-96348294-d287-4785-826e-19b4ee77625b tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:42:07.464122 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-96348294-d287-4785-826e-19b4ee77625b tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:42:07.464574 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-96348294-d287-4785-826e-19b4ee77625b tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:42:07.465342 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-96348294-d287-4785-826e-19b4ee77625b tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:42:07.465842 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-96348294-d287-4785-826e-19b4ee77625b tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:42:07.466313 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-96348294-d287-4785-826e-19b4ee77625b tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:42:07.609423 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-96348294-d287-4785-826e-19b4ee77625b tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ec3d4f006c4f8f815b0cad9f933208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c52563210cf435696f3e3ae3907b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:42:07.617653 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-96348294-d287-4785-826e-19b4ee77625b tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] 10.222.0.23 "GET /compute/v2.1/servers/d4bd5be5-501a-42aa-b8ad-4f302c5d3c77" status: 200 len: 1265 microversion: 2.1 time: 0.168921 Sep 09 16:42:07.618219 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 521/1029] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:42:07 2022] GET /compute/v2.1/servers/d4bd5be5-501a-42aa-b8ad-4f302c5d3c77 => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:42:08.647717 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-e996d483-6e25-47d9-9541-85763a3b4e94 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:42:08.648677 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-e996d483-6e25-47d9-9541-85763a3b4e94 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] [instance: d4bd5be5-501a-42aa-b8ad-4f302c5d3c77] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:42:08.652499 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG dbcounter [-] [127196] Writing DB stats nova_cell0:SELECT=2 {{(pid=127196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:42:08.653633 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG dbcounter [-] [127196] Writing DB stats nova_cell0:SELECT=6 {{(pid=127196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:42:08.662138 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e996d483-6e25-47d9-9541-85763a3b4e94 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:42:08.662857 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e996d483-6e25-47d9-9541-85763a3b4e94 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:42:08.663283 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e996d483-6e25-47d9-9541-85763a3b4e94 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:42:08.664016 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e996d483-6e25-47d9-9541-85763a3b4e94 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:42:08.664464 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e996d483-6e25-47d9-9541-85763a3b4e94 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:42:08.664892 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e996d483-6e25-47d9-9541-85763a3b4e94 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:42:08.807071 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-e996d483-6e25-47d9-9541-85763a3b4e94 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ec3d4f006c4f8f815b0cad9f933208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c52563210cf435696f3e3ae3907b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:42:08.815151 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-e996d483-6e25-47d9-9541-85763a3b4e94 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] 10.222.0.23 "GET /compute/v2.1/servers/d4bd5be5-501a-42aa-b8ad-4f302c5d3c77" status: 200 len: 1265 microversion: 2.1 time: 0.174126 Sep 09 16:42:08.815720 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 509/1030] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:42:08 2022] GET /compute/v2.1/servers/d4bd5be5-501a-42aa-b8ad-4f302c5d3c77 => generated 1265 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:42:09.842087 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-f9a870d6-d7a7-4260-82bd-e74fe2cf9247 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:42:09.843126 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-f9a870d6-d7a7-4260-82bd-e74fe2cf9247 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] [instance: d4bd5be5-501a-42aa-b8ad-4f302c5d3c77] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:42:09.846535 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell0:SELECT=2 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:42:09.852182 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f9a870d6-d7a7-4260-82bd-e74fe2cf9247 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:42:09.852661 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f9a870d6-d7a7-4260-82bd-e74fe2cf9247 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:42:09.853092 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f9a870d6-d7a7-4260-82bd-e74fe2cf9247 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:42:09.853776 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f9a870d6-d7a7-4260-82bd-e74fe2cf9247 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:42:09.854227 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f9a870d6-d7a7-4260-82bd-e74fe2cf9247 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:42:09.854674 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f9a870d6-d7a7-4260-82bd-e74fe2cf9247 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:42:09.990968 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-f9a870d6-d7a7-4260-82bd-e74fe2cf9247 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ec3d4f006c4f8f815b0cad9f933208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c52563210cf435696f3e3ae3907b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:42:09.999109 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-f9a870d6-d7a7-4260-82bd-e74fe2cf9247 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] 10.222.0.23 "GET /compute/v2.1/servers/d4bd5be5-501a-42aa-b8ad-4f302c5d3c77" status: 200 len: 1265 microversion: 2.1 time: 0.163571 Sep 09 16:42:09.999671 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 522/1031] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:42:09 2022] GET /compute/v2.1/servers/d4bd5be5-501a-42aa-b8ad-4f302c5d3c77 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:42:11.026207 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-c9e1f469-8afb-497a-a1d1-b28ca448eacc tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:42:11.027170 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-c9e1f469-8afb-497a-a1d1-b28ca448eacc tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] [instance: d4bd5be5-501a-42aa-b8ad-4f302c5d3c77] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:42:11.038407 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-c9e1f469-8afb-497a-a1d1-b28ca448eacc tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:42:11.039267 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-c9e1f469-8afb-497a-a1d1-b28ca448eacc tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:42:11.039994 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-c9e1f469-8afb-497a-a1d1-b28ca448eacc tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:42:11.041160 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-c9e1f469-8afb-497a-a1d1-b28ca448eacc tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:42:11.041921 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-c9e1f469-8afb-497a-a1d1-b28ca448eacc tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:42:11.042687 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-c9e1f469-8afb-497a-a1d1-b28ca448eacc tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:42:11.193655 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-c9e1f469-8afb-497a-a1d1-b28ca448eacc tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ec3d4f006c4f8f815b0cad9f933208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c52563210cf435696f3e3ae3907b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:42:11.201740 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-c9e1f469-8afb-497a-a1d1-b28ca448eacc tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] 10.222.0.23 "GET /compute/v2.1/servers/d4bd5be5-501a-42aa-b8ad-4f302c5d3c77" status: 200 len: 1265 microversion: 2.1 time: 0.182254 Sep 09 16:42:11.202311 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 510/1032] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:42:11 2022] GET /compute/v2.1/servers/d4bd5be5-501a-42aa-b8ad-4f302c5d3c77 => generated 1265 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:42:12.224216 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-8ef4bc48-5d41-49c0-bdb8-d1f5e51cd51a tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:42:12.224788 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-8ef4bc48-5d41-49c0-bdb8-d1f5e51cd51a tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] [instance: d4bd5be5-501a-42aa-b8ad-4f302c5d3c77] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:42:12.231414 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8ef4bc48-5d41-49c0-bdb8-d1f5e51cd51a tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:42:12.231892 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8ef4bc48-5d41-49c0-bdb8-d1f5e51cd51a tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:42:12.232316 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8ef4bc48-5d41-49c0-bdb8-d1f5e51cd51a tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:42:12.233002 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8ef4bc48-5d41-49c0-bdb8-d1f5e51cd51a tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:42:12.233450 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8ef4bc48-5d41-49c0-bdb8-d1f5e51cd51a tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:42:12.233868 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8ef4bc48-5d41-49c0-bdb8-d1f5e51cd51a tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:42:12.368312 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-8ef4bc48-5d41-49c0-bdb8-d1f5e51cd51a tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ec3d4f006c4f8f815b0cad9f933208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c52563210cf435696f3e3ae3907b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:42:12.376474 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-8ef4bc48-5d41-49c0-bdb8-d1f5e51cd51a tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] 10.222.0.23 "GET /compute/v2.1/servers/d4bd5be5-501a-42aa-b8ad-4f302c5d3c77" status: 200 len: 1265 microversion: 2.1 time: 0.156383 Sep 09 16:42:12.377045 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 523/1033] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:42:12 2022] GET /compute/v2.1/servers/d4bd5be5-501a-42aa-b8ad-4f302c5d3c77 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:42:13.403028 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-da4cdca9-b91f-4f59-a4d8-3995fbe56657 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:42:13.404022 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-da4cdca9-b91f-4f59-a4d8-3995fbe56657 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] [instance: d4bd5be5-501a-42aa-b8ad-4f302c5d3c77] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:42:13.415223 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-da4cdca9-b91f-4f59-a4d8-3995fbe56657 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:42:13.416015 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-da4cdca9-b91f-4f59-a4d8-3995fbe56657 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:42:13.416727 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-da4cdca9-b91f-4f59-a4d8-3995fbe56657 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:42:13.417874 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-da4cdca9-b91f-4f59-a4d8-3995fbe56657 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:42:13.418827 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-da4cdca9-b91f-4f59-a4d8-3995fbe56657 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:42:13.419507 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-da4cdca9-b91f-4f59-a4d8-3995fbe56657 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:42:13.565833 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-da4cdca9-b91f-4f59-a4d8-3995fbe56657 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ec3d4f006c4f8f815b0cad9f933208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c52563210cf435696f3e3ae3907b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:42:13.573975 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-da4cdca9-b91f-4f59-a4d8-3995fbe56657 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] 10.222.0.23 "GET /compute/v2.1/servers/d4bd5be5-501a-42aa-b8ad-4f302c5d3c77" status: 200 len: 1265 microversion: 2.1 time: 0.177392 Sep 09 16:42:13.574796 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 511/1034] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:42:13 2022] GET /compute/v2.1/servers/d4bd5be5-501a-42aa-b8ad-4f302c5d3c77 => generated 1265 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 16:42:13.815653 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [req-12c8075c-6819-473c-aa37-9ef98c5ba58b req-9ec30886-8c9e-47fe-ad17-997bf0aa4843 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4bd5be5-501a-42aa-b8ad-4f302c5d3c77", "name": "network-vif-plugged", "status": "completed", "tag": "c2509bb6-b9e5-44be-b2a0-f91a4c2c58fb"}]} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:42:13.826938 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-12c8075c-6819-473c-aa37-9ef98c5ba58b req-9ec30886-8c9e-47fe-ad17-997bf0aa4843 service nova] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:42:13.827531 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-12c8075c-6819-473c-aa37-9ef98c5ba58b req-9ec30886-8c9e-47fe-ad17-997bf0aa4843 service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:42:13.828242 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-12c8075c-6819-473c-aa37-9ef98c5ba58b req-9ec30886-8c9e-47fe-ad17-997bf0aa4843 service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:42:13.840091 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.compute.server_external_events [req-12c8075c-6819-473c-aa37-9ef98c5ba58b req-9ec30886-8c9e-47fe-ad17-997bf0aa4843 service nova] Creating event network-vif-plugged:c2509bb6-b9e5-44be-b2a0-f91a4c2c58fb for instance d4bd5be5-501a-42aa-b8ad-4f302c5d3c77 on hv-cinder-83124 Sep 09 16:42:13.845116 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [req-12c8075c-6819-473c-aa37-9ef98c5ba58b req-9ec30886-8c9e-47fe-ad17-997bf0aa4843 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033201 Sep 09 16:42:13.845694 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 524/1035] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Sep 9 16:42:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:42:14.600906 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-4e9af4d7-95ea-48c3-b7ac-5407454c6f50 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:42:14.601577 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-4e9af4d7-95ea-48c3-b7ac-5407454c6f50 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] [instance: d4bd5be5-501a-42aa-b8ad-4f302c5d3c77] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:42:14.608535 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-4e9af4d7-95ea-48c3-b7ac-5407454c6f50 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:42:14.609069 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-4e9af4d7-95ea-48c3-b7ac-5407454c6f50 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:42:14.609549 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-4e9af4d7-95ea-48c3-b7ac-5407454c6f50 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:42:14.610312 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-4e9af4d7-95ea-48c3-b7ac-5407454c6f50 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:42:14.610850 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-4e9af4d7-95ea-48c3-b7ac-5407454c6f50 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:42:14.611320 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-4e9af4d7-95ea-48c3-b7ac-5407454c6f50 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:42:14.752063 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-4e9af4d7-95ea-48c3-b7ac-5407454c6f50 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ec3d4f006c4f8f815b0cad9f933208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c52563210cf435696f3e3ae3907b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:42:14.764142 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-4e9af4d7-95ea-48c3-b7ac-5407454c6f50 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] 10.222.0.23 "GET /compute/v2.1/servers/d4bd5be5-501a-42aa-b8ad-4f302c5d3c77" status: 200 len: 1265 microversion: 2.1 time: 0.168642 Sep 09 16:42:14.764897 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 512/1036] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:42:14 2022] GET /compute/v2.1/servers/d4bd5be5-501a-42aa-b8ad-4f302c5d3c77 => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:42:15.793784 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-6d4ceefe-1ac2-4a6c-9473-006e67fee3bd tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:42:15.794937 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-6d4ceefe-1ac2-4a6c-9473-006e67fee3bd tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] [instance: d4bd5be5-501a-42aa-b8ad-4f302c5d3c77] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:42:15.805352 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6d4ceefe-1ac2-4a6c-9473-006e67fee3bd tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:42:15.806166 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6d4ceefe-1ac2-4a6c-9473-006e67fee3bd tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:42:15.806921 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6d4ceefe-1ac2-4a6c-9473-006e67fee3bd tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:42:15.808050 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6d4ceefe-1ac2-4a6c-9473-006e67fee3bd tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:42:15.808799 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6d4ceefe-1ac2-4a6c-9473-006e67fee3bd tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:42:15.809498 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6d4ceefe-1ac2-4a6c-9473-006e67fee3bd tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:42:15.950244 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-6d4ceefe-1ac2-4a6c-9473-006e67fee3bd tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ec3d4f006c4f8f815b0cad9f933208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c52563210cf435696f3e3ae3907b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:42:15.958464 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-6d4ceefe-1ac2-4a6c-9473-006e67fee3bd tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] 10.222.0.23 "GET /compute/v2.1/servers/d4bd5be5-501a-42aa-b8ad-4f302c5d3c77" status: 200 len: 1452 microversion: 2.1 time: 0.172761 Sep 09 16:42:15.959133 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 525/1037] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:42:15 2022] GET /compute/v2.1/servers/d4bd5be5-501a-42aa-b8ad-4f302c5d3c77 => generated 1452 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:42:15.980801 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-bcacf5d4-95b4-4cb1-8583-e59678199db9 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:42:15.981402 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-bcacf5d4-95b4-4cb1-8583-e59678199db9 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] [instance: d4bd5be5-501a-42aa-b8ad-4f302c5d3c77] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:42:15.988284 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-bcacf5d4-95b4-4cb1-8583-e59678199db9 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:42:15.988764 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-bcacf5d4-95b4-4cb1-8583-e59678199db9 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:42:15.989184 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-bcacf5d4-95b4-4cb1-8583-e59678199db9 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:42:15.989877 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-bcacf5d4-95b4-4cb1-8583-e59678199db9 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:42:15.990316 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-bcacf5d4-95b4-4cb1-8583-e59678199db9 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:42:15.990774 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-bcacf5d4-95b4-4cb1-8583-e59678199db9 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:42:16.131578 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-bcacf5d4-95b4-4cb1-8583-e59678199db9 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ec3d4f006c4f8f815b0cad9f933208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c52563210cf435696f3e3ae3907b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:42:16.143107 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-bcacf5d4-95b4-4cb1-8583-e59678199db9 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] 10.222.0.23 "GET /compute/v2.1/servers/d4bd5be5-501a-42aa-b8ad-4f302c5d3c77" status: 200 len: 1452 microversion: 2.1 time: 0.165876 Sep 09 16:42:16.143849 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 513/1038] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:42:15 2022] GET /compute/v2.1/servers/d4bd5be5-501a-42aa-b8ad-4f302c5d3c77 => generated 1452 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:42:17.784838 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [req-48cf9e5e-c738-414e-8f96-2f91600ee4c0 req-d3a0861f-8212-49d3-9de0-6f7b6a94d7a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4bd5be5-501a-42aa-b8ad-4f302c5d3c77", "tag": "c2509bb6-b9e5-44be-b2a0-f91a4c2c58fb"}]} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:42:17.794984 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-48cf9e5e-c738-414e-8f96-2f91600ee4c0 req-d3a0861f-8212-49d3-9de0-6f7b6a94d7a9 service nova] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:42:17.795455 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-48cf9e5e-c738-414e-8f96-2f91600ee4c0 req-d3a0861f-8212-49d3-9de0-6f7b6a94d7a9 service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:42:17.795876 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-48cf9e5e-c738-414e-8f96-2f91600ee4c0 req-d3a0861f-8212-49d3-9de0-6f7b6a94d7a9 service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:42:17.806983 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.compute.server_external_events [req-48cf9e5e-c738-414e-8f96-2f91600ee4c0 req-d3a0861f-8212-49d3-9de0-6f7b6a94d7a9 service nova] Creating event network-changed:c2509bb6-b9e5-44be-b2a0-f91a4c2c58fb for instance d4bd5be5-501a-42aa-b8ad-4f302c5d3c77 on hv-cinder-83124 Sep 09 16:42:17.811929 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [req-48cf9e5e-c738-414e-8f96-2f91600ee4c0 req-d3a0861f-8212-49d3-9de0-6f7b6a94d7a9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031205 Sep 09 16:42:17.812513 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 526/1039] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Sep 9 16:42:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:44:12.885846 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR oslo.messaging._drivers.impl_rabbit [-] [164f13df-3999-453c-8b98-0aefe667cca4] AMQP server on 10.222.0.23:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 09 16:44:12.890899 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-a4e392af-3183-4e7b-b4af-04f5b37a5817 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:44:12.891521 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-a4e392af-3183-4e7b-b4af-04f5b37a5817 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] [instance: d4bd5be5-501a-42aa-b8ad-4f302c5d3c77] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:44:12.893742 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG dbcounter [-] [127196] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=127196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:44:12.894393 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG dbcounter [-] [127196] Writing DB stats nova_cell1:SELECT=52 {{(pid=127196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:44:12.895910 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 09 16:44:12.896127 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Fri Sep 9 16:44:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d4bd5be5-501a-42aa-b8ad-4f302c5d3c77 (ip 10.222.0.23) !!! Sep 09 16:44:12.897645 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Sep 09 16:44:12.906480 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-a4e392af-3183-4e7b-b4af-04f5b37a5817 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:44:12.907000 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-a4e392af-3183-4e7b-b4af-04f5b37a5817 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:44:12.907412 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-a4e392af-3183-4e7b-b4af-04f5b37a5817 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:44:12.908499 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-a4e392af-3183-4e7b-b4af-04f5b37a5817 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:44:12.908951 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-a4e392af-3183-4e7b-b4af-04f5b37a5817 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:44:12.909368 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-a4e392af-3183-4e7b-b4af-04f5b37a5817 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:44:12.935711 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-a4e392af-3183-4e7b-b4af-04f5b37a5817 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] [instance: d4bd5be5-501a-42aa-b8ad-4f302c5d3c77] Going to try to terminate instance {{(pid=127196) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 16:44:13.016644 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-a4e392af-3183-4e7b-b4af-04f5b37a5817 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] 10.222.0.23 "DELETE /compute/v2.1/servers/d4bd5be5-501a-42aa-b8ad-4f302c5d3c77" status: 204 len: 0 microversion: 2.1 time: 0.132707 Sep 09 16:44:13.017320 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 514/1040] 10.222.0.23 () {58 vars in 1239 bytes} [Fri Sep 9 16:44:12 2022] DELETE /compute/v2.1/servers/d4bd5be5-501a-42aa-b8ad-4f302c5d3c77 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 16:44:13.024254 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR oslo.messaging._drivers.impl_rabbit [-] [35c6ea1d-2d89-4c57-920c-f4851202efdc] AMQP server on 10.222.0.23:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Sep 09 16:44:13.025485 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_api:SELECT=22 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:44:13.026217 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell1:SELECT=46 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:44:13.027727 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Sep 09 16:44:13.034361 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-e2c4b1c7-9d6a-4e6d-ad78-9157c3128e21 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:44:13.035124 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-e2c4b1c7-9d6a-4e6d-ad78-9157c3128e21 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] [instance: d4bd5be5-501a-42aa-b8ad-4f302c5d3c77] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:44:13.041923 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e2c4b1c7-9d6a-4e6d-ad78-9157c3128e21 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:44:13.042401 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e2c4b1c7-9d6a-4e6d-ad78-9157c3128e21 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:44:13.042885 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e2c4b1c7-9d6a-4e6d-ad78-9157c3128e21 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:44:13.043568 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e2c4b1c7-9d6a-4e6d-ad78-9157c3128e21 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:44:13.044019 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e2c4b1c7-9d6a-4e6d-ad78-9157c3128e21 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:44:13.044438 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e2c4b1c7-9d6a-4e6d-ad78-9157c3128e21 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:44:13.181444 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-e2c4b1c7-9d6a-4e6d-ad78-9157c3128e21 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ec3d4f006c4f8f815b0cad9f933208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c52563210cf435696f3e3ae3907b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:44:13.189640 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-e2c4b1c7-9d6a-4e6d-ad78-9157c3128e21 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] 10.222.0.23 "GET /compute/v2.1/servers/d4bd5be5-501a-42aa-b8ad-4f302c5d3c77" status: 200 len: 1577 microversion: 2.1 time: 0.167417 Sep 09 16:44:13.190133 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 527/1041] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:44:13 2022] GET /compute/v2.1/servers/d4bd5be5-501a-42aa-b8ad-4f302c5d3c77 => generated 1577 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:44:14.214255 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-180596fa-f185-4eee-82be-d5e42fe6d40c tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:44:14.214881 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-180596fa-f185-4eee-82be-d5e42fe6d40c tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] [instance: d4bd5be5-501a-42aa-b8ad-4f302c5d3c77] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:44:14.222704 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-180596fa-f185-4eee-82be-d5e42fe6d40c tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:44:14.223183 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-180596fa-f185-4eee-82be-d5e42fe6d40c tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:44:14.223616 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-180596fa-f185-4eee-82be-d5e42fe6d40c tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:44:14.224306 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-180596fa-f185-4eee-82be-d5e42fe6d40c tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:44:14.224756 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-180596fa-f185-4eee-82be-d5e42fe6d40c tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:44:14.225172 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-180596fa-f185-4eee-82be-d5e42fe6d40c tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:44:14.231247 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO oslo.messaging._drivers.impl_rabbit [-] [164f13df-3999-453c-8b98-0aefe667cca4] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 59028. Sep 09 16:44:14.367757 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-180596fa-f185-4eee-82be-d5e42fe6d40c tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ec3d4f006c4f8f815b0cad9f933208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c52563210cf435696f3e3ae3907b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:44:14.378318 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-180596fa-f185-4eee-82be-d5e42fe6d40c tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] 10.222.0.23 "GET /compute/v2.1/servers/d4bd5be5-501a-42aa-b8ad-4f302c5d3c77" status: 200 len: 1577 microversion: 2.1 time: 0.168514 Sep 09 16:44:14.378922 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 515/1042] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:44:14 2022] GET /compute/v2.1/servers/d4bd5be5-501a-42aa-b8ad-4f302c5d3c77 => generated 1577 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:44:15.389052 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO oslo.messaging._drivers.impl_rabbit [-] [35c6ea1d-2d89-4c57-920c-f4851202efdc] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 59034. Sep 09 16:44:15.401566 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-73acc49c-b1f0-442c-8e10-57bd48846ae3 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:44:15.402220 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-73acc49c-b1f0-442c-8e10-57bd48846ae3 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] [instance: d4bd5be5-501a-42aa-b8ad-4f302c5d3c77] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:44:15.414129 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-73acc49c-b1f0-442c-8e10-57bd48846ae3 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:44:15.414876 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-73acc49c-b1f0-442c-8e10-57bd48846ae3 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:44:15.415321 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-73acc49c-b1f0-442c-8e10-57bd48846ae3 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:44:15.416068 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-73acc49c-b1f0-442c-8e10-57bd48846ae3 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:44:15.416816 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-73acc49c-b1f0-442c-8e10-57bd48846ae3 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:44:15.417335 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-73acc49c-b1f0-442c-8e10-57bd48846ae3 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:44:15.444466 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [req-174154ae-bbc1-4b44-a1a9-64967ddadd83 req-8ac8cd4d-1905-4192-8932-647a6cace286 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4bd5be5-501a-42aa-b8ad-4f302c5d3c77", "name": "network-vif-deleted", "tag": "c2509bb6-b9e5-44be-b2a0-f91a4c2c58fb"}]} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:44:15.456290 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-174154ae-bbc1-4b44-a1a9-64967ddadd83 req-8ac8cd4d-1905-4192-8932-647a6cace286 service nova] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:44:15.457095 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-174154ae-bbc1-4b44-a1a9-64967ddadd83 req-8ac8cd4d-1905-4192-8932-647a6cace286 service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:44:15.457687 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-174154ae-bbc1-4b44-a1a9-64967ddadd83 req-8ac8cd4d-1905-4192-8932-647a6cace286 service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:44:15.474210 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.compute.server_external_events [req-174154ae-bbc1-4b44-a1a9-64967ddadd83 req-8ac8cd4d-1905-4192-8932-647a6cace286 service nova] Creating event network-vif-deleted:c2509bb6-b9e5-44be-b2a0-f91a4c2c58fb for instance d4bd5be5-501a-42aa-b8ad-4f302c5d3c77 on hv-cinder-83124 Sep 09 16:44:15.479982 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [req-174154ae-bbc1-4b44-a1a9-64967ddadd83 req-8ac8cd4d-1905-4192-8932-647a6cace286 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104351 Sep 09 16:44:15.480809 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 528/1043] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Sep 9 16:44:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:44:15.513762 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-73acc49c-b1f0-442c-8e10-57bd48846ae3 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ec3d4f006c4f8f815b0cad9f933208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c52563210cf435696f3e3ae3907b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:44:15.521823 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-73acc49c-b1f0-442c-8e10-57bd48846ae3 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] 10.222.0.23 "GET /compute/v2.1/servers/d4bd5be5-501a-42aa-b8ad-4f302c5d3c77" status: 200 len: 1225 microversion: 2.1 time: 0.124255 Sep 09 16:44:15.522401 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 516/1044] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:44:15 2022] GET /compute/v2.1/servers/d4bd5be5-501a-42aa-b8ad-4f302c5d3c77 => generated 1225 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:44:16.549893 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-a90c3eb0-7c1d-4b20-beda-1a0fdf6f81d9 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:44:16.550675 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-a90c3eb0-7c1d-4b20-beda-1a0fdf6f81d9 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] [instance: d4bd5be5-501a-42aa-b8ad-4f302c5d3c77] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:44:16.557406 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a90c3eb0-7c1d-4b20-beda-1a0fdf6f81d9 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:44:16.557910 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a90c3eb0-7c1d-4b20-beda-1a0fdf6f81d9 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:44:16.558361 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a90c3eb0-7c1d-4b20-beda-1a0fdf6f81d9 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:44:16.559161 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a90c3eb0-7c1d-4b20-beda-1a0fdf6f81d9 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:44:16.559619 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a90c3eb0-7c1d-4b20-beda-1a0fdf6f81d9 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:44:16.560046 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a90c3eb0-7c1d-4b20-beda-1a0fdf6f81d9 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:44:16.573902 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.wsgi [None req-a90c3eb0-7c1d-4b20-beda-1a0fdf6f81d9 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] HTTP exception thrown: Instance d4bd5be5-501a-42aa-b8ad-4f302c5d3c77 could not be found. Sep 09 16:44:16.575596 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-a90c3eb0-7c1d-4b20-beda-1a0fdf6f81d9 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Request method failure captured: Sep 09 16:44:16.575596 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: request: GET /compute/v2.1/servers/d4bd5be5-501a-42aa-b8ad-4f302c5d3c77 HTTP/1.1 Sep 09 16:44:16.575596 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Accept: application/json Sep 09 16:44:16.575596 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Accept-Encoding: identity Sep 09 16:44:16.575596 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Connection: close Sep 09 16:44:16.575596 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Content-Length: 0 Sep 09 16:44:16.575596 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Content-Type: application/json Sep 09 16:44:16.575596 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Host: 10.222.0.23 Sep 09 16:44:16.575596 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Openstack-System-Scope: None Sep 09 16:44:16.575596 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: User-Agent: python-urllib3/1.26.12 Sep 09 16:44:16.575596 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Auth-Token: gAAAAABjG2zA2C3Urjs5rX1aJ4LKhkL3u9nZn6jfJf116bnd56Qt97VVQ7ocGpj0lL75heJHPdN6Cw3P9LXL57icrantDpvxWBIY8Uq_2L9Afi5dh46vkZJCYW06kaJAfmsx1WEU03C9lzGI0XC3nzAEIQPaqhPRx8PWaHcRcTSHjYzjfP4jc6o Sep 09 16:44:16.575596 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Domain-Id: None Sep 09 16:44:16.575596 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Domain-Name: None Sep 09 16:44:16.575596 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Identity-Status: Confirmed Sep 09 16:44:16.575596 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Is-Admin-Project: True Sep 09 16:44:16.575596 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Project-Domain-Id: default Sep 09 16:44:16.575596 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Project-Domain-Name: Default Sep 09 16:44:16.575596 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Project-Id: 5c52563210cf435696f3e3ae3907b0fb Sep 09 16:44:16.575596 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Project-Name: tempest-TestVolumeBootPattern-44960866 Sep 09 16:44:16.575596 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Role: member,reader Sep 09 16:44:16.575596 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Roles: member,reader Sep 09 16:44:16.577442 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5c52563210cf435696f3e3ae3907b0fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/5c52563210cf435696f3e3ae3907b0fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5c52563210cf435696f3e3ae3907b0fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_5c52563210cf435696f3e3ae3907b0fb"}]}] Sep 09 16:44:16.577442 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Tenant: tempest-TestVolumeBootPattern-44960866 Sep 09 16:44:16.577442 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Tenant-Id: 5c52563210cf435696f3e3ae3907b0fb Sep 09 16:44:16.577442 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Tenant-Name: tempest-TestVolumeBootPattern-44960866 Sep 09 16:44:16.577442 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User: tempest-TestVolumeBootPattern-44960866-project Sep 09 16:44:16.577442 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User-Domain-Id: default Sep 09 16:44:16.577442 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User-Domain-Name: Default Sep 09 16:44:16.577442 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User-Id: 69ec3d4f006c4f8f815b0cad9f933208 Sep 09 16:44:16.577442 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User-Name: tempest-TestVolumeBootPattern-44960866-project Sep 09 16:44:16.577442 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: method: > Sep 09 16:44:16.577442 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: exception: Instance d4bd5be5-501a-42aa-b8ad-4f302c5d3c77 could not be found. Sep 09 16:44:16.577442 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: action_args: {'id': 'd4bd5be5-501a-42aa-b8ad-4f302c5d3c77'} Sep 09 16:44:16.578382 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 16:44:16.578382 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:44:16.578382 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 16:44:16.578382 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 16:44:16.578382 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 16:44:16.578382 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 16:44:16.578382 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 16:44:16.578382 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 16:44:16.578382 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 16:44:16.578382 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 16:44:16.578382 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4bd5be5-501a-42aa-b8ad-4f302c5d3c77 could not be found. Sep 09 16:44:16.578382 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:44:16.578382 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 16:44:16.578382 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:44:16.578382 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:44:16.578382 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 16:44:16.578382 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 16:44:16.578382 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 16:44:16.578382 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 16:44:16.578382 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 16:44:16.579888 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 16:44:16.579888 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 16:44:16.579888 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 16:44:16.579888 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 16:44:16.579888 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 16:44:16.579888 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 16:44:16.579888 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 16:44:16.579888 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4bd5be5-501a-42aa-b8ad-4f302c5d3c77 could not be found. Sep 09 16:44:16.579888 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:44:16.579888 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 16:44:16.579888 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:44:16.579888 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:44:16.579888 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 16:44:16.579888 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 16:44:16.579888 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 16:44:16.579888 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 16:44:16.579888 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4bd5be5-501a-42aa-b8ad-4f302c5d3c77 could not be found. Sep 09 16:44:16.579888 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:44:16.581195 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-a90c3eb0-7c1d-4b20-beda-1a0fdf6f81d9 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Returning 404 to user: Instance d4bd5be5-501a-42aa-b8ad-4f302c5d3c77 could not be found. {{(pid=127198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 16:44:16.581195 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-a90c3eb0-7c1d-4b20-beda-1a0fdf6f81d9 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] 10.222.0.23 "GET /compute/v2.1/servers/d4bd5be5-501a-42aa-b8ad-4f302c5d3c77" status: 404 len: 111 microversion: 2.1 time: 0.033953 Sep 09 16:44:16.581195 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 529/1045] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:44:16 2022] GET /compute/v2.1/servers/d4bd5be5-501a-42aa-b8ad-4f302c5d3c77 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 16:44:16.629231 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-39d4cec6-5564-4460-87a7-f361ef3a8019 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-884663345", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-471889667", "security_groups": [{"name": "tempest-secgroup-smoke-336681543"}], "block_device_mapping_v2": [{"uuid": "736b6354-8dff-4909-a81b-1609b806afc5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b6e09802-a0bc-4038-92b1-56776749943b"}]}} {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:44:16.746243 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.network.neutron [None req-39d4cec6-5564-4460-87a7-f361ef3a8019 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] validate_networks() for [('b6e09802-a0bc-4038-92b1-56776749943b', None, None, None, None, None)] {{(pid=127196) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 16:44:17.205897 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.virt.hardware [None req-39d4cec6-5564-4460-87a7-f361ef3a8019 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Flavor limits 0:0:0 {{(pid=127196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 16:44:17.206352 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.virt.hardware [None req-39d4cec6-5564-4460-87a7-f361ef3a8019 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Image limits 0:0:0 {{(pid=127196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 16:44:17.206867 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.virt.hardware [None req-39d4cec6-5564-4460-87a7-f361ef3a8019 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Flavor pref 0:0:0 {{(pid=127196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 16:44:17.207280 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.virt.hardware [None req-39d4cec6-5564-4460-87a7-f361ef3a8019 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Image pref 0:0:0 {{(pid=127196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 16:44:17.207691 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.virt.hardware [None req-39d4cec6-5564-4460-87a7-f361ef3a8019 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 16:44:17.216936 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-39d4cec6-5564-4460-87a7-f361ef3a8019 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:44:17.217429 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-39d4cec6-5564-4460-87a7-f361ef3a8019 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:44:17.217869 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-39d4cec6-5564-4460-87a7-f361ef3a8019 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:44:17.218636 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-39d4cec6-5564-4460-87a7-f361ef3a8019 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:44:17.219136 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-39d4cec6-5564-4460-87a7-f361ef3a8019 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:44:17.219626 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-39d4cec6-5564-4460-87a7-f361ef3a8019 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:44:17.236397 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.quota [None req-39d4cec6-5564-4460-87a7-f361ef3a8019 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Getting quotas for project 5c52563210cf435696f3e3ae3907b0fb. Resources: {'cores', 'instances', 'ram'} {{(pid=127196) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 16:44:17.240668 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.quota [None req-39d4cec6-5564-4460-87a7-f361ef3a8019 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Getting quotas for user 69ec3d4f006c4f8f815b0cad9f933208 and project 5c52563210cf435696f3e3ae3907b0fb. Resources: {'cores', 'instances', 'ram'} {{(pid=127196) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 16:44:17.298517 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-39d4cec6-5564-4460-87a7-f361ef3a8019 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Going to run 1 instances... {{(pid=127196) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 16:44:17.300674 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-39d4cec6-5564-4460-87a7-f361ef3a8019 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] [instance: ceecb9dd-9cdc-4d73-afdc-9392417e0b36] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='736b6354-8dff-4909-a81b-1609b806afc5',volume_size=None,volume_type=None)] {{(pid=127196) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 16:44:17.444152 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-39d4cec6-5564-4460-87a7-f361ef3a8019 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.818932 Sep 09 16:44:17.444800 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 517/1046] 10.222.0.23 () {60 vars in 1147 bytes} [Fri Sep 9 16:44:16 2022] POST /compute/v2.1/servers => generated 405 bytes in 820 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 16:44:17.456145 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-10c3faf9-058d-4484-852a-cb1214d7c7c6 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:44:17.456718 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-10c3faf9-058d-4484-852a-cb1214d7c7c6 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] [instance: ceecb9dd-9cdc-4d73-afdc-9392417e0b36] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:44:17.510920 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-10c3faf9-058d-4484-852a-cb1214d7c7c6 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ec3d4f006c4f8f815b0cad9f933208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c52563210cf435696f3e3ae3907b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:44:17.519068 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-10c3faf9-058d-4484-852a-cb1214d7c7c6 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] 10.222.0.23 "GET /compute/v2.1/servers/ceecb9dd-9cdc-4d73-afdc-9392417e0b36" status: 200 len: 1093 microversion: 2.1 time: 0.066851 Sep 09 16:44:17.519724 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 530/1047] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:44:17 2022] GET /compute/v2.1/servers/ceecb9dd-9cdc-4d73-afdc-9392417e0b36 => generated 1093 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:44:18.544025 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-a5b8ab63-4e03-4b29-8de5-03901f60cb16 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:44:18.545675 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-a5b8ab63-4e03-4b29-8de5-03901f60cb16 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] [instance: ceecb9dd-9cdc-4d73-afdc-9392417e0b36] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:44:18.555961 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-a5b8ab63-4e03-4b29-8de5-03901f60cb16 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:44:18.556575 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-a5b8ab63-4e03-4b29-8de5-03901f60cb16 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:44:18.557438 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-a5b8ab63-4e03-4b29-8de5-03901f60cb16 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:44:18.559002 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-a5b8ab63-4e03-4b29-8de5-03901f60cb16 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:44:18.559774 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-a5b8ab63-4e03-4b29-8de5-03901f60cb16 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:44:18.560801 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-a5b8ab63-4e03-4b29-8de5-03901f60cb16 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:44:18.636542 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-a5b8ab63-4e03-4b29-8de5-03901f60cb16 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ec3d4f006c4f8f815b0cad9f933208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c52563210cf435696f3e3ae3907b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:44:18.644786 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-a5b8ab63-4e03-4b29-8de5-03901f60cb16 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] 10.222.0.23 "GET /compute/v2.1/servers/ceecb9dd-9cdc-4d73-afdc-9392417e0b36" status: 200 len: 1199 microversion: 2.1 time: 0.105679 Sep 09 16:44:18.645391 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 518/1048] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:44:18 2022] GET /compute/v2.1/servers/ceecb9dd-9cdc-4d73-afdc-9392417e0b36 => generated 1199 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:44:19.675731 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-a9cb42bc-f420-493a-ae75-5cb37efdd455 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:44:19.676435 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-a9cb42bc-f420-493a-ae75-5cb37efdd455 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] [instance: ceecb9dd-9cdc-4d73-afdc-9392417e0b36] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:44:19.685344 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a9cb42bc-f420-493a-ae75-5cb37efdd455 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:44:19.685915 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a9cb42bc-f420-493a-ae75-5cb37efdd455 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:44:19.686346 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a9cb42bc-f420-493a-ae75-5cb37efdd455 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:44:19.687287 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a9cb42bc-f420-493a-ae75-5cb37efdd455 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:44:19.687740 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a9cb42bc-f420-493a-ae75-5cb37efdd455 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:44:19.688193 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a9cb42bc-f420-493a-ae75-5cb37efdd455 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:44:19.909993 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-a9cb42bc-f420-493a-ae75-5cb37efdd455 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ec3d4f006c4f8f815b0cad9f933208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c52563210cf435696f3e3ae3907b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:44:19.918116 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-a9cb42bc-f420-493a-ae75-5cb37efdd455 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] 10.222.0.23 "GET /compute/v2.1/servers/ceecb9dd-9cdc-4d73-afdc-9392417e0b36" status: 200 len: 1264 microversion: 2.1 time: 0.246283 Sep 09 16:44:19.918632 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 531/1049] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:44:19 2022] GET /compute/v2.1/servers/ceecb9dd-9cdc-4d73-afdc-9392417e0b36 => generated 1264 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 16:44:20.084386 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [req-01e04a67-bba3-4b8f-a764-1e3f6c32c0a0 req-25e2aeef-1549-4675-8a05-f12c029d9345 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ceecb9dd-9cdc-4d73-afdc-9392417e0b36", "tag": "2e31f866-d5cb-4860-b630-ec38d3ce3f6b"}]} {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:44:20.099063 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [req-01e04a67-bba3-4b8f-a764-1e3f6c32c0a0 req-25e2aeef-1549-4675-8a05-f12c029d9345 service nova] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:44:20.099565 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [req-01e04a67-bba3-4b8f-a764-1e3f6c32c0a0 req-25e2aeef-1549-4675-8a05-f12c029d9345 service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:44:20.100174 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [req-01e04a67-bba3-4b8f-a764-1e3f6c32c0a0 req-25e2aeef-1549-4675-8a05-f12c029d9345 service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:44:20.112102 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.compute.server_external_events [req-01e04a67-bba3-4b8f-a764-1e3f6c32c0a0 req-25e2aeef-1549-4675-8a05-f12c029d9345 service nova] Creating event network-changed:2e31f866-d5cb-4860-b630-ec38d3ce3f6b for instance ceecb9dd-9cdc-4d73-afdc-9392417e0b36 on hv-cinder-83124 Sep 09 16:44:20.117163 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [req-01e04a67-bba3-4b8f-a764-1e3f6c32c0a0 req-25e2aeef-1549-4675-8a05-f12c029d9345 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036516 Sep 09 16:44:20.117754 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 519/1050] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Sep 9 16:44:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:44:20.941989 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-fa1fce15-7854-445e-9fe2-ce6aa5913be6 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:44:20.942625 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-fa1fce15-7854-445e-9fe2-ce6aa5913be6 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] [instance: ceecb9dd-9cdc-4d73-afdc-9392417e0b36] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:44:20.949329 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fa1fce15-7854-445e-9fe2-ce6aa5913be6 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:44:20.949876 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fa1fce15-7854-445e-9fe2-ce6aa5913be6 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:44:20.950302 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fa1fce15-7854-445e-9fe2-ce6aa5913be6 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:44:20.951028 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fa1fce15-7854-445e-9fe2-ce6aa5913be6 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:44:20.951477 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fa1fce15-7854-445e-9fe2-ce6aa5913be6 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:44:20.951888 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fa1fce15-7854-445e-9fe2-ce6aa5913be6 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:44:21.160625 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-fa1fce15-7854-445e-9fe2-ce6aa5913be6 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ec3d4f006c4f8f815b0cad9f933208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c52563210cf435696f3e3ae3907b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:44:21.168768 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-fa1fce15-7854-445e-9fe2-ce6aa5913be6 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] 10.222.0.23 "GET /compute/v2.1/servers/ceecb9dd-9cdc-4d73-afdc-9392417e0b36" status: 200 len: 1264 microversion: 2.1 time: 0.230809 Sep 09 16:44:21.169328 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 532/1051] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:44:20 2022] GET /compute/v2.1/servers/ceecb9dd-9cdc-4d73-afdc-9392417e0b36 => generated 1264 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:44:22.197581 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-7ac03cc5-b93e-446e-8ba2-05e7cb2e4608 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:44:22.198779 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-7ac03cc5-b93e-446e-8ba2-05e7cb2e4608 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] [instance: ceecb9dd-9cdc-4d73-afdc-9392417e0b36] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:44:22.208326 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-7ac03cc5-b93e-446e-8ba2-05e7cb2e4608 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:44:22.208804 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-7ac03cc5-b93e-446e-8ba2-05e7cb2e4608 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:44:22.209236 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-7ac03cc5-b93e-446e-8ba2-05e7cb2e4608 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:44:22.209925 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-7ac03cc5-b93e-446e-8ba2-05e7cb2e4608 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:44:22.210404 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-7ac03cc5-b93e-446e-8ba2-05e7cb2e4608 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:44:22.210834 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-7ac03cc5-b93e-446e-8ba2-05e7cb2e4608 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:44:22.352253 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-7ac03cc5-b93e-446e-8ba2-05e7cb2e4608 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ec3d4f006c4f8f815b0cad9f933208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c52563210cf435696f3e3ae3907b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:44:22.360085 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-7ac03cc5-b93e-446e-8ba2-05e7cb2e4608 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] 10.222.0.23 "GET /compute/v2.1/servers/ceecb9dd-9cdc-4d73-afdc-9392417e0b36" status: 200 len: 1264 microversion: 2.1 time: 0.170273 Sep 09 16:44:22.360655 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 520/1052] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:44:22 2022] GET /compute/v2.1/servers/ceecb9dd-9cdc-4d73-afdc-9392417e0b36 => generated 1264 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:44:23.387058 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-95063a8d-8341-4895-b6f0-36a56bf87a36 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:44:23.387993 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-95063a8d-8341-4895-b6f0-36a56bf87a36 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] [instance: ceecb9dd-9cdc-4d73-afdc-9392417e0b36] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:44:23.399021 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-95063a8d-8341-4895-b6f0-36a56bf87a36 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:44:23.399821 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-95063a8d-8341-4895-b6f0-36a56bf87a36 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:44:23.400539 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-95063a8d-8341-4895-b6f0-36a56bf87a36 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:44:23.401670 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-95063a8d-8341-4895-b6f0-36a56bf87a36 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:44:23.402420 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-95063a8d-8341-4895-b6f0-36a56bf87a36 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:44:23.403165 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-95063a8d-8341-4895-b6f0-36a56bf87a36 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:44:23.555044 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-95063a8d-8341-4895-b6f0-36a56bf87a36 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ec3d4f006c4f8f815b0cad9f933208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c52563210cf435696f3e3ae3907b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:44:23.566772 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-95063a8d-8341-4895-b6f0-36a56bf87a36 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] 10.222.0.23 "GET /compute/v2.1/servers/ceecb9dd-9cdc-4d73-afdc-9392417e0b36" status: 200 len: 1264 microversion: 2.1 time: 0.185974 Sep 09 16:44:23.567660 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 533/1053] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:44:23 2022] GET /compute/v2.1/servers/ceecb9dd-9cdc-4d73-afdc-9392417e0b36 => generated 1264 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:44:24.592711 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-e7fb30ed-ee7b-4889-8b38-8db303e2de47 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:44:24.593875 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-e7fb30ed-ee7b-4889-8b38-8db303e2de47 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] [instance: ceecb9dd-9cdc-4d73-afdc-9392417e0b36] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:44:24.602691 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e7fb30ed-ee7b-4889-8b38-8db303e2de47 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:44:24.603278 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e7fb30ed-ee7b-4889-8b38-8db303e2de47 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:44:24.603983 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e7fb30ed-ee7b-4889-8b38-8db303e2de47 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:44:24.605064 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e7fb30ed-ee7b-4889-8b38-8db303e2de47 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:44:24.605801 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e7fb30ed-ee7b-4889-8b38-8db303e2de47 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:44:24.606488 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e7fb30ed-ee7b-4889-8b38-8db303e2de47 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:44:24.748334 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-e7fb30ed-ee7b-4889-8b38-8db303e2de47 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ec3d4f006c4f8f815b0cad9f933208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c52563210cf435696f3e3ae3907b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:44:24.758855 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-e7fb30ed-ee7b-4889-8b38-8db303e2de47 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] 10.222.0.23 "GET /compute/v2.1/servers/ceecb9dd-9cdc-4d73-afdc-9392417e0b36" status: 200 len: 1264 microversion: 2.1 time: 0.172281 Sep 09 16:44:24.759441 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 521/1054] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:44:24 2022] GET /compute/v2.1/servers/ceecb9dd-9cdc-4d73-afdc-9392417e0b36 => generated 1264 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:44:25.786480 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-a0316d5f-7c85-49e8-9ac4-21ae0d32c9db tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:44:25.787273 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-a0316d5f-7c85-49e8-9ac4-21ae0d32c9db tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] [instance: ceecb9dd-9cdc-4d73-afdc-9392417e0b36] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:44:25.796079 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a0316d5f-7c85-49e8-9ac4-21ae0d32c9db tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:44:25.797093 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a0316d5f-7c85-49e8-9ac4-21ae0d32c9db tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:44:25.797672 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a0316d5f-7c85-49e8-9ac4-21ae0d32c9db tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:44:25.798638 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a0316d5f-7c85-49e8-9ac4-21ae0d32c9db tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:44:25.799242 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a0316d5f-7c85-49e8-9ac4-21ae0d32c9db tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:44:25.799805 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a0316d5f-7c85-49e8-9ac4-21ae0d32c9db tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:44:25.944426 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-a0316d5f-7c85-49e8-9ac4-21ae0d32c9db tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ec3d4f006c4f8f815b0cad9f933208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c52563210cf435696f3e3ae3907b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:44:25.956853 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-a0316d5f-7c85-49e8-9ac4-21ae0d32c9db tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] 10.222.0.23 "GET /compute/v2.1/servers/ceecb9dd-9cdc-4d73-afdc-9392417e0b36" status: 200 len: 1264 microversion: 2.1 time: 0.177143 Sep 09 16:44:25.957633 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 534/1055] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:44:25 2022] GET /compute/v2.1/servers/ceecb9dd-9cdc-4d73-afdc-9392417e0b36 => generated 1264 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:44:26.984033 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-8ddb77b0-bbb9-4a0f-aa5f-f560dd849bbd tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:44:26.985041 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-8ddb77b0-bbb9-4a0f-aa5f-f560dd849bbd tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] [instance: ceecb9dd-9cdc-4d73-afdc-9392417e0b36] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:44:26.993867 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-8ddb77b0-bbb9-4a0f-aa5f-f560dd849bbd tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:44:26.994358 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-8ddb77b0-bbb9-4a0f-aa5f-f560dd849bbd tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:44:26.994785 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-8ddb77b0-bbb9-4a0f-aa5f-f560dd849bbd tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:44:26.995510 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-8ddb77b0-bbb9-4a0f-aa5f-f560dd849bbd tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:44:26.995964 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-8ddb77b0-bbb9-4a0f-aa5f-f560dd849bbd tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:44:26.996385 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-8ddb77b0-bbb9-4a0f-aa5f-f560dd849bbd tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:44:27.141385 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-8ddb77b0-bbb9-4a0f-aa5f-f560dd849bbd tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ec3d4f006c4f8f815b0cad9f933208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c52563210cf435696f3e3ae3907b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:44:27.152660 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-8ddb77b0-bbb9-4a0f-aa5f-f560dd849bbd tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] 10.222.0.23 "GET /compute/v2.1/servers/ceecb9dd-9cdc-4d73-afdc-9392417e0b36" status: 200 len: 1264 microversion: 2.1 time: 0.175184 Sep 09 16:44:27.153392 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 522/1056] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:44:26 2022] GET /compute/v2.1/servers/ceecb9dd-9cdc-4d73-afdc-9392417e0b36 => generated 1264 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:44:28.181593 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-af7a5a2b-7c7a-4e17-a6ff-8a7fed1e8da0 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:44:28.182176 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-af7a5a2b-7c7a-4e17-a6ff-8a7fed1e8da0 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] [instance: ceecb9dd-9cdc-4d73-afdc-9392417e0b36] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:44:28.184563 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell0:SELECT=2 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:44:28.190167 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-af7a5a2b-7c7a-4e17-a6ff-8a7fed1e8da0 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:44:28.190710 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-af7a5a2b-7c7a-4e17-a6ff-8a7fed1e8da0 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:44:28.191440 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-af7a5a2b-7c7a-4e17-a6ff-8a7fed1e8da0 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:44:28.192135 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-af7a5a2b-7c7a-4e17-a6ff-8a7fed1e8da0 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:44:28.192581 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-af7a5a2b-7c7a-4e17-a6ff-8a7fed1e8da0 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:44:28.192994 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-af7a5a2b-7c7a-4e17-a6ff-8a7fed1e8da0 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:44:28.329659 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-af7a5a2b-7c7a-4e17-a6ff-8a7fed1e8da0 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ec3d4f006c4f8f815b0cad9f933208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c52563210cf435696f3e3ae3907b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:44:28.338159 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-af7a5a2b-7c7a-4e17-a6ff-8a7fed1e8da0 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] 10.222.0.23 "GET /compute/v2.1/servers/ceecb9dd-9cdc-4d73-afdc-9392417e0b36" status: 200 len: 1264 microversion: 2.1 time: 0.161533 Sep 09 16:44:28.338783 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 535/1057] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:44:28 2022] GET /compute/v2.1/servers/ceecb9dd-9cdc-4d73-afdc-9392417e0b36 => generated 1264 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:44:29.365029 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-5c2076cf-1c21-410f-808c-a94949eab6e6 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:44:29.366077 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-5c2076cf-1c21-410f-808c-a94949eab6e6 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] [instance: ceecb9dd-9cdc-4d73-afdc-9392417e0b36] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:44:29.369130 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG dbcounter [-] [127196] Writing DB stats nova_cell0:SELECT=2 {{(pid=127196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:44:29.370194 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG dbcounter [-] [127196] Writing DB stats nova_cell0:SELECT=6 {{(pid=127196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:44:29.381621 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-5c2076cf-1c21-410f-808c-a94949eab6e6 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:44:29.382093 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-5c2076cf-1c21-410f-808c-a94949eab6e6 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:44:29.382527 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-5c2076cf-1c21-410f-808c-a94949eab6e6 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:44:29.383242 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-5c2076cf-1c21-410f-808c-a94949eab6e6 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:44:29.383716 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-5c2076cf-1c21-410f-808c-a94949eab6e6 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:44:29.384109 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-5c2076cf-1c21-410f-808c-a94949eab6e6 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:44:29.530981 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-5c2076cf-1c21-410f-808c-a94949eab6e6 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ec3d4f006c4f8f815b0cad9f933208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c52563210cf435696f3e3ae3907b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:44:29.539629 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-5c2076cf-1c21-410f-808c-a94949eab6e6 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] 10.222.0.23 "GET /compute/v2.1/servers/ceecb9dd-9cdc-4d73-afdc-9392417e0b36" status: 200 len: 1264 microversion: 2.1 time: 0.181165 Sep 09 16:44:29.540208 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 523/1058] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:44:29 2022] GET /compute/v2.1/servers/ceecb9dd-9cdc-4d73-afdc-9392417e0b36 => generated 1264 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:44:30.563398 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-67392caa-e4ac-4415-a8ca-c9321aea1d02 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:44:30.564215 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-67392caa-e4ac-4415-a8ca-c9321aea1d02 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] [instance: ceecb9dd-9cdc-4d73-afdc-9392417e0b36] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:44:30.571501 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-67392caa-e4ac-4415-a8ca-c9321aea1d02 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:44:30.572090 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-67392caa-e4ac-4415-a8ca-c9321aea1d02 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:44:30.572572 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-67392caa-e4ac-4415-a8ca-c9321aea1d02 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:44:30.573436 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-67392caa-e4ac-4415-a8ca-c9321aea1d02 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:44:30.573953 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-67392caa-e4ac-4415-a8ca-c9321aea1d02 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:44:30.574450 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-67392caa-e4ac-4415-a8ca-c9321aea1d02 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:44:30.606784 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [req-66a6bc4d-03fe-43f3-8be0-e2c682ed5c21 req-fe9b48b5-d76f-4cd4-bd34-53cef0b05463 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ceecb9dd-9cdc-4d73-afdc-9392417e0b36", "name": "network-vif-plugged", "status": "completed", "tag": "2e31f866-d5cb-4860-b630-ec38d3ce3f6b"}]} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:44:30.616512 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-66a6bc4d-03fe-43f3-8be0-e2c682ed5c21 req-fe9b48b5-d76f-4cd4-bd34-53cef0b05463 service nova] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:44:30.617474 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-66a6bc4d-03fe-43f3-8be0-e2c682ed5c21 req-fe9b48b5-d76f-4cd4-bd34-53cef0b05463 service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:44:30.617928 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-66a6bc4d-03fe-43f3-8be0-e2c682ed5c21 req-fe9b48b5-d76f-4cd4-bd34-53cef0b05463 service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:44:30.629576 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.compute.server_external_events [req-66a6bc4d-03fe-43f3-8be0-e2c682ed5c21 req-fe9b48b5-d76f-4cd4-bd34-53cef0b05463 service nova] Creating event network-vif-plugged:2e31f866-d5cb-4860-b630-ec38d3ce3f6b for instance ceecb9dd-9cdc-4d73-afdc-9392417e0b36 on hv-cinder-83124 Sep 09 16:44:30.634677 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [req-66a6bc4d-03fe-43f3-8be0-e2c682ed5c21 req-fe9b48b5-d76f-4cd4-bd34-53cef0b05463 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090618 Sep 09 16:44:30.635513 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 536/1059] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Sep 9 16:44:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:44:30.713561 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-67392caa-e4ac-4415-a8ca-c9321aea1d02 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ec3d4f006c4f8f815b0cad9f933208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c52563210cf435696f3e3ae3907b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:44:30.721557 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-67392caa-e4ac-4415-a8ca-c9321aea1d02 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] 10.222.0.23 "GET /compute/v2.1/servers/ceecb9dd-9cdc-4d73-afdc-9392417e0b36" status: 200 len: 1264 microversion: 2.1 time: 0.162824 Sep 09 16:44:30.722130 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 524/1060] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:44:30 2022] GET /compute/v2.1/servers/ceecb9dd-9cdc-4d73-afdc-9392417e0b36 => generated 1264 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:44:31.750789 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-47926e37-934f-4ec1-8a8c-bb3a3a6a5503 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:44:31.751898 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-47926e37-934f-4ec1-8a8c-bb3a3a6a5503 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] [instance: ceecb9dd-9cdc-4d73-afdc-9392417e0b36] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:44:31.761019 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-47926e37-934f-4ec1-8a8c-bb3a3a6a5503 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:44:31.761493 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-47926e37-934f-4ec1-8a8c-bb3a3a6a5503 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:44:31.761928 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-47926e37-934f-4ec1-8a8c-bb3a3a6a5503 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:44:31.762645 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-47926e37-934f-4ec1-8a8c-bb3a3a6a5503 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:44:31.763098 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-47926e37-934f-4ec1-8a8c-bb3a3a6a5503 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:44:31.763523 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-47926e37-934f-4ec1-8a8c-bb3a3a6a5503 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:44:31.903702 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-47926e37-934f-4ec1-8a8c-bb3a3a6a5503 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ec3d4f006c4f8f815b0cad9f933208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c52563210cf435696f3e3ae3907b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:44:31.915783 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-47926e37-934f-4ec1-8a8c-bb3a3a6a5503 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] 10.222.0.23 "GET /compute/v2.1/servers/ceecb9dd-9cdc-4d73-afdc-9392417e0b36" status: 200 len: 1264 microversion: 2.1 time: 0.172574 Sep 09 16:44:31.916551 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 537/1061] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:44:31 2022] GET /compute/v2.1/servers/ceecb9dd-9cdc-4d73-afdc-9392417e0b36 => generated 1264 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:44:32.944167 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-ba034a13-b441-4da0-8d10-44747ebe8d33 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:44:32.944811 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-ba034a13-b441-4da0-8d10-44747ebe8d33 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] [instance: ceecb9dd-9cdc-4d73-afdc-9392417e0b36] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:44:32.951823 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-ba034a13-b441-4da0-8d10-44747ebe8d33 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:44:32.952309 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-ba034a13-b441-4da0-8d10-44747ebe8d33 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:44:32.952739 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-ba034a13-b441-4da0-8d10-44747ebe8d33 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:44:32.953441 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-ba034a13-b441-4da0-8d10-44747ebe8d33 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:44:32.953893 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-ba034a13-b441-4da0-8d10-44747ebe8d33 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:44:32.954323 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-ba034a13-b441-4da0-8d10-44747ebe8d33 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:44:33.086792 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-ba034a13-b441-4da0-8d10-44747ebe8d33 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ec3d4f006c4f8f815b0cad9f933208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c52563210cf435696f3e3ae3907b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:44:33.095106 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-ba034a13-b441-4da0-8d10-44747ebe8d33 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] 10.222.0.23 "GET /compute/v2.1/servers/ceecb9dd-9cdc-4d73-afdc-9392417e0b36" status: 200 len: 1451 microversion: 2.1 time: 0.155029 Sep 09 16:44:33.095719 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 525/1062] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:44:32 2022] GET /compute/v2.1/servers/ceecb9dd-9cdc-4d73-afdc-9392417e0b36 => generated 1451 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:44:33.117234 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-66617860-92fd-454c-a509-e84425d03146 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:44:33.117847 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-66617860-92fd-454c-a509-e84425d03146 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] [instance: ceecb9dd-9cdc-4d73-afdc-9392417e0b36] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:44:33.124442 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-66617860-92fd-454c-a509-e84425d03146 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:44:33.124914 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-66617860-92fd-454c-a509-e84425d03146 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:44:33.125345 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-66617860-92fd-454c-a509-e84425d03146 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:44:33.126030 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-66617860-92fd-454c-a509-e84425d03146 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:44:33.126476 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-66617860-92fd-454c-a509-e84425d03146 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:44:33.126928 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-66617860-92fd-454c-a509-e84425d03146 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:44:33.534944 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-66617860-92fd-454c-a509-e84425d03146 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ec3d4f006c4f8f815b0cad9f933208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c52563210cf435696f3e3ae3907b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:44:33.547240 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-66617860-92fd-454c-a509-e84425d03146 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] 10.222.0.23 "GET /compute/v2.1/servers/ceecb9dd-9cdc-4d73-afdc-9392417e0b36" status: 200 len: 1451 microversion: 2.1 time: 0.433566 Sep 09 16:44:33.548091 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 538/1063] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:44:33 2022] GET /compute/v2.1/servers/ceecb9dd-9cdc-4d73-afdc-9392417e0b36 => generated 1451 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:44:35.192119 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [req-19f78ff1-d2ef-407b-a691-5452dbad285a req-eb4a8d1d-22e3-4598-b3ce-1bbcefe7c218 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ceecb9dd-9cdc-4d73-afdc-9392417e0b36", "tag": "2e31f866-d5cb-4860-b630-ec38d3ce3f6b"}]} {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:44:35.202319 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [req-19f78ff1-d2ef-407b-a691-5452dbad285a req-eb4a8d1d-22e3-4598-b3ce-1bbcefe7c218 service nova] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:44:35.202964 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [req-19f78ff1-d2ef-407b-a691-5452dbad285a req-eb4a8d1d-22e3-4598-b3ce-1bbcefe7c218 service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:44:35.203459 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [req-19f78ff1-d2ef-407b-a691-5452dbad285a req-eb4a8d1d-22e3-4598-b3ce-1bbcefe7c218 service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:44:35.214874 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.compute.server_external_events [req-19f78ff1-d2ef-407b-a691-5452dbad285a req-eb4a8d1d-22e3-4598-b3ce-1bbcefe7c218 service nova] Creating event network-changed:2e31f866-d5cb-4860-b630-ec38d3ce3f6b for instance ceecb9dd-9cdc-4d73-afdc-9392417e0b36 on hv-cinder-83124 Sep 09 16:44:35.220254 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [req-19f78ff1-d2ef-407b-a691-5452dbad285a req-eb4a8d1d-22e3-4598-b3ce-1bbcefe7c218 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031966 Sep 09 16:44:35.220999 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 526/1064] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Sep 9 16:44:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:46:08.501340 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_api:SELECT=26 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:46:08.502233 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell1:SELECT=54 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:46:08.503317 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 09 16:46:08.503492 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Fri Sep 9 16:46:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.23) !!! Sep 09 16:46:08.507876 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-b562c54a-4817-4bc6-9c7c-ca9d6246a297 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-703753186", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-471889667", "security_groups": [{"name": "tempest-secgroup-smoke-336681543"}], "block_device_mapping_v2": [{"uuid": "8194da68-6111-4f32-ada8-e64d87ea2b4b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b6e09802-a0bc-4038-92b1-56776749943b"}]}} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:46:08.628320 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.network.neutron [None req-b562c54a-4817-4bc6-9c7c-ca9d6246a297 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] validate_networks() for [('b6e09802-a0bc-4038-92b1-56776749943b', None, None, None, None, None)] {{(pid=127198) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 16:46:09.065467 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-b562c54a-4817-4bc6-9c7c-ca9d6246a297 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Flavor limits 0:0:0 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 16:46:09.066101 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-b562c54a-4817-4bc6-9c7c-ca9d6246a297 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Image limits 0:0:0 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 16:46:09.066846 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-b562c54a-4817-4bc6-9c7c-ca9d6246a297 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Flavor pref 0:0:0 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 16:46:09.067430 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-b562c54a-4817-4bc6-9c7c-ca9d6246a297 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Image pref 0:0:0 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 16:46:09.068007 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-b562c54a-4817-4bc6-9c7c-ca9d6246a297 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 16:46:09.079001 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b562c54a-4817-4bc6-9c7c-ca9d6246a297 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:46:09.079502 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b562c54a-4817-4bc6-9c7c-ca9d6246a297 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:46:09.079982 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b562c54a-4817-4bc6-9c7c-ca9d6246a297 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:46:09.081094 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b562c54a-4817-4bc6-9c7c-ca9d6246a297 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:46:09.081793 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b562c54a-4817-4bc6-9c7c-ca9d6246a297 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:46:09.082402 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b562c54a-4817-4bc6-9c7c-ca9d6246a297 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:46:09.100024 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.quota [None req-b562c54a-4817-4bc6-9c7c-ca9d6246a297 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Getting quotas for project 5c52563210cf435696f3e3ae3907b0fb. Resources: {'cores', 'instances', 'ram'} {{(pid=127198) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 16:46:09.104250 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.quota [None req-b562c54a-4817-4bc6-9c7c-ca9d6246a297 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Getting quotas for user 69ec3d4f006c4f8f815b0cad9f933208 and project 5c52563210cf435696f3e3ae3907b0fb. Resources: {'cores', 'instances', 'ram'} {{(pid=127198) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 16:46:09.163395 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-b562c54a-4817-4bc6-9c7c-ca9d6246a297 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Going to run 1 instances... {{(pid=127198) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 16:46:09.165540 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-b562c54a-4817-4bc6-9c7c-ca9d6246a297 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] [instance: af4e30b5-ee16-477c-8d6a-8fabf4fc7696] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8194da68-6111-4f32-ada8-e64d87ea2b4b',volume_size=None,volume_type=None)] {{(pid=127198) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 16:46:09.320627 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-b562c54a-4817-4bc6-9c7c-ca9d6246a297 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.821052 Sep 09 16:46:09.321278 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 539/1065] 10.222.0.23 () {60 vars in 1147 bytes} [Fri Sep 9 16:46:08 2022] POST /compute/v2.1/servers => generated 405 bytes in 822 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 16:46:09.331129 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG dbcounter [-] [127196] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:46:09.331972 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG dbcounter [-] [127196] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:46:09.337845 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-fee400a7-2f1d-4410-809f-99134a89e625 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:46:09.338546 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-fee400a7-2f1d-4410-809f-99134a89e625 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] [instance: af4e30b5-ee16-477c-8d6a-8fabf4fc7696] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:46:09.394527 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-fee400a7-2f1d-4410-809f-99134a89e625 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ec3d4f006c4f8f815b0cad9f933208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c52563210cf435696f3e3ae3907b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:46:09.401499 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-fee400a7-2f1d-4410-809f-99134a89e625 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] 10.222.0.23 "GET /compute/v2.1/servers/af4e30b5-ee16-477c-8d6a-8fabf4fc7696" status: 200 len: 1093 microversion: 2.1 time: 0.072742 Sep 09 16:46:09.402069 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 527/1066] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:46:09 2022] GET /compute/v2.1/servers/af4e30b5-ee16-477c-8d6a-8fabf4fc7696 => generated 1093 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 16:46:10.424810 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-ea4fcd6c-e600-40d2-b5de-0b6c63602dc1 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:46:10.425386 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-ea4fcd6c-e600-40d2-b5de-0b6c63602dc1 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] [instance: af4e30b5-ee16-477c-8d6a-8fabf4fc7696] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:46:10.478490 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-ea4fcd6c-e600-40d2-b5de-0b6c63602dc1 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ec3d4f006c4f8f815b0cad9f933208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c52563210cf435696f3e3ae3907b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:46:10.485414 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-ea4fcd6c-e600-40d2-b5de-0b6c63602dc1 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] 10.222.0.23 "GET /compute/v2.1/servers/af4e30b5-ee16-477c-8d6a-8fabf4fc7696" status: 200 len: 1093 microversion: 2.1 time: 0.064535 Sep 09 16:46:10.485973 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 540/1067] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:46:10 2022] GET /compute/v2.1/servers/af4e30b5-ee16-477c-8d6a-8fabf4fc7696 => generated 1093 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:46:11.507944 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-242169e3-ffab-4ec5-bff7-3ebe01b4e337 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:46:11.508559 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-242169e3-ffab-4ec5-bff7-3ebe01b4e337 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] [instance: af4e30b5-ee16-477c-8d6a-8fabf4fc7696] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:46:11.563174 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-242169e3-ffab-4ec5-bff7-3ebe01b4e337 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ec3d4f006c4f8f815b0cad9f933208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c52563210cf435696f3e3ae3907b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:46:11.570418 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-242169e3-ffab-4ec5-bff7-3ebe01b4e337 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] 10.222.0.23 "GET /compute/v2.1/servers/af4e30b5-ee16-477c-8d6a-8fabf4fc7696" status: 200 len: 1093 microversion: 2.1 time: 0.066337 Sep 09 16:46:11.571006 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 528/1068] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:46:11 2022] GET /compute/v2.1/servers/af4e30b5-ee16-477c-8d6a-8fabf4fc7696 => generated 1093 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:46:12.598249 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-7d700011-9ff6-48c0-b31f-d04845b5db05 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:46:12.599369 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-7d700011-9ff6-48c0-b31f-d04845b5db05 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] [instance: af4e30b5-ee16-477c-8d6a-8fabf4fc7696] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:46:12.923100 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-7d700011-9ff6-48c0-b31f-d04845b5db05 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ec3d4f006c4f8f815b0cad9f933208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c52563210cf435696f3e3ae3907b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:46:12.930532 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-7d700011-9ff6-48c0-b31f-d04845b5db05 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] 10.222.0.23 "GET /compute/v2.1/servers/af4e30b5-ee16-477c-8d6a-8fabf4fc7696" status: 200 len: 1093 microversion: 2.1 time: 0.338836 Sep 09 16:46:12.931114 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 541/1069] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:46:12 2022] GET /compute/v2.1/servers/af4e30b5-ee16-477c-8d6a-8fabf4fc7696 => generated 1093 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:46:13.953130 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-828f11ac-ac75-4682-9694-dadfffdc68b7 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:46:13.953736 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-828f11ac-ac75-4682-9694-dadfffdc68b7 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] [instance: af4e30b5-ee16-477c-8d6a-8fabf4fc7696] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:46:13.960515 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-828f11ac-ac75-4682-9694-dadfffdc68b7 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:46:13.961000 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-828f11ac-ac75-4682-9694-dadfffdc68b7 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:46:13.961428 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-828f11ac-ac75-4682-9694-dadfffdc68b7 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:46:13.962122 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-828f11ac-ac75-4682-9694-dadfffdc68b7 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:46:13.962679 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-828f11ac-ac75-4682-9694-dadfffdc68b7 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:46:13.963096 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-828f11ac-ac75-4682-9694-dadfffdc68b7 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:46:14.029256 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-828f11ac-ac75-4682-9694-dadfffdc68b7 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ec3d4f006c4f8f815b0cad9f933208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c52563210cf435696f3e3ae3907b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:46:14.037729 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-828f11ac-ac75-4682-9694-dadfffdc68b7 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] 10.222.0.23 "GET /compute/v2.1/servers/af4e30b5-ee16-477c-8d6a-8fabf4fc7696" status: 200 len: 1135 microversion: 2.1 time: 0.088542 Sep 09 16:46:14.038300 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 529/1070] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:46:13 2022] GET /compute/v2.1/servers/af4e30b5-ee16-477c-8d6a-8fabf4fc7696 => generated 1135 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:46:15.060908 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-6448c88f-87b8-4028-8e96-853949a044f8 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:46:15.061559 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-6448c88f-87b8-4028-8e96-853949a044f8 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] [instance: af4e30b5-ee16-477c-8d6a-8fabf4fc7696] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:46:15.068570 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6448c88f-87b8-4028-8e96-853949a044f8 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:46:15.069070 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6448c88f-87b8-4028-8e96-853949a044f8 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:46:15.069500 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6448c88f-87b8-4028-8e96-853949a044f8 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:46:15.070254 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6448c88f-87b8-4028-8e96-853949a044f8 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:46:15.070736 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6448c88f-87b8-4028-8e96-853949a044f8 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:46:15.071172 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6448c88f-87b8-4028-8e96-853949a044f8 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:46:15.300098 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-6448c88f-87b8-4028-8e96-853949a044f8 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ec3d4f006c4f8f815b0cad9f933208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c52563210cf435696f3e3ae3907b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:46:15.308523 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-6448c88f-87b8-4028-8e96-853949a044f8 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] 10.222.0.23 "GET /compute/v2.1/servers/af4e30b5-ee16-477c-8d6a-8fabf4fc7696" status: 200 len: 1264 microversion: 2.1 time: 0.251414 Sep 09 16:46:15.309015 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 542/1071] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:46:15 2022] GET /compute/v2.1/servers/af4e30b5-ee16-477c-8d6a-8fabf4fc7696 => generated 1264 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:46:15.879056 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [req-b9bb46ad-a333-4daf-abe6-4bf324dfbc0e req-8680e74b-2a13-4bae-90a7-eec4e77896a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af4e30b5-ee16-477c-8d6a-8fabf4fc7696", "tag": "71e424e1-c604-42d0-b606-e08bedda19a0"}]} {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:46:15.889337 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [req-b9bb46ad-a333-4daf-abe6-4bf324dfbc0e req-8680e74b-2a13-4bae-90a7-eec4e77896a2 service nova] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:46:15.889814 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [req-b9bb46ad-a333-4daf-abe6-4bf324dfbc0e req-8680e74b-2a13-4bae-90a7-eec4e77896a2 service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:46:15.890238 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [req-b9bb46ad-a333-4daf-abe6-4bf324dfbc0e req-8680e74b-2a13-4bae-90a7-eec4e77896a2 service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:46:15.902783 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.compute.server_external_events [req-b9bb46ad-a333-4daf-abe6-4bf324dfbc0e req-8680e74b-2a13-4bae-90a7-eec4e77896a2 service nova] Creating event network-changed:71e424e1-c604-42d0-b606-e08bedda19a0 for instance af4e30b5-ee16-477c-8d6a-8fabf4fc7696 on hv-cinder-83124 Sep 09 16:46:15.908301 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [req-b9bb46ad-a333-4daf-abe6-4bf324dfbc0e req-8680e74b-2a13-4bae-90a7-eec4e77896a2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033189 Sep 09 16:46:15.908894 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 530/1072] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Sep 9 16:46:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:46:16.332689 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-7b0d41fb-901b-4d89-a97c-fa0ab1b9d25a tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:46:16.333302 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-7b0d41fb-901b-4d89-a97c-fa0ab1b9d25a tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] [instance: af4e30b5-ee16-477c-8d6a-8fabf4fc7696] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:46:16.339648 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7b0d41fb-901b-4d89-a97c-fa0ab1b9d25a tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:46:16.340135 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7b0d41fb-901b-4d89-a97c-fa0ab1b9d25a tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:46:16.340568 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7b0d41fb-901b-4d89-a97c-fa0ab1b9d25a tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:46:16.341263 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7b0d41fb-901b-4d89-a97c-fa0ab1b9d25a tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:46:16.341712 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7b0d41fb-901b-4d89-a97c-fa0ab1b9d25a tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:46:16.342133 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7b0d41fb-901b-4d89-a97c-fa0ab1b9d25a tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:46:16.478101 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-7b0d41fb-901b-4d89-a97c-fa0ab1b9d25a tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ec3d4f006c4f8f815b0cad9f933208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c52563210cf435696f3e3ae3907b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:46:16.486254 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-7b0d41fb-901b-4d89-a97c-fa0ab1b9d25a tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] 10.222.0.23 "GET /compute/v2.1/servers/af4e30b5-ee16-477c-8d6a-8fabf4fc7696" status: 200 len: 1264 microversion: 2.1 time: 0.158099 Sep 09 16:46:16.486858 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 543/1073] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:46:16 2022] GET /compute/v2.1/servers/af4e30b5-ee16-477c-8d6a-8fabf4fc7696 => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:46:17.515061 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-72db6cbb-8de8-400e-803a-d21e24cb91d5 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:46:17.516266 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-72db6cbb-8de8-400e-803a-d21e24cb91d5 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] [instance: af4e30b5-ee16-477c-8d6a-8fabf4fc7696] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:46:17.525795 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-72db6cbb-8de8-400e-803a-d21e24cb91d5 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:46:17.526299 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-72db6cbb-8de8-400e-803a-d21e24cb91d5 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:46:17.526784 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-72db6cbb-8de8-400e-803a-d21e24cb91d5 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:46:17.527453 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-72db6cbb-8de8-400e-803a-d21e24cb91d5 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:46:17.527917 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-72db6cbb-8de8-400e-803a-d21e24cb91d5 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:46:17.528324 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-72db6cbb-8de8-400e-803a-d21e24cb91d5 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:46:17.667398 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-72db6cbb-8de8-400e-803a-d21e24cb91d5 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ec3d4f006c4f8f815b0cad9f933208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c52563210cf435696f3e3ae3907b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:46:17.675455 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-72db6cbb-8de8-400e-803a-d21e24cb91d5 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] 10.222.0.23 "GET /compute/v2.1/servers/af4e30b5-ee16-477c-8d6a-8fabf4fc7696" status: 200 len: 1264 microversion: 2.1 time: 0.168343 Sep 09 16:46:17.676023 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 531/1074] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:46:17 2022] GET /compute/v2.1/servers/af4e30b5-ee16-477c-8d6a-8fabf4fc7696 => generated 1264 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:46:18.710067 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-b3f2a125-f9c1-4388-8b5e-8cfb497670a2 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:46:18.711105 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-b3f2a125-f9c1-4388-8b5e-8cfb497670a2 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] [instance: af4e30b5-ee16-477c-8d6a-8fabf4fc7696] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:46:18.718041 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b3f2a125-f9c1-4388-8b5e-8cfb497670a2 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:46:18.718546 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b3f2a125-f9c1-4388-8b5e-8cfb497670a2 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:46:18.718990 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b3f2a125-f9c1-4388-8b5e-8cfb497670a2 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:46:18.719680 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b3f2a125-f9c1-4388-8b5e-8cfb497670a2 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:46:18.720136 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b3f2a125-f9c1-4388-8b5e-8cfb497670a2 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:46:18.720559 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b3f2a125-f9c1-4388-8b5e-8cfb497670a2 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:46:18.855902 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-b3f2a125-f9c1-4388-8b5e-8cfb497670a2 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ec3d4f006c4f8f815b0cad9f933208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c52563210cf435696f3e3ae3907b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:46:18.864386 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-b3f2a125-f9c1-4388-8b5e-8cfb497670a2 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] 10.222.0.23 "GET /compute/v2.1/servers/af4e30b5-ee16-477c-8d6a-8fabf4fc7696" status: 200 len: 1264 microversion: 2.1 time: 0.160828 Sep 09 16:46:18.864961 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 544/1075] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:46:18 2022] GET /compute/v2.1/servers/af4e30b5-ee16-477c-8d6a-8fabf4fc7696 => generated 1264 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:46:19.891983 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-6df5f476-8df2-4f94-a069-e2fbccd720e2 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:46:19.892954 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-6df5f476-8df2-4f94-a069-e2fbccd720e2 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] [instance: af4e30b5-ee16-477c-8d6a-8fabf4fc7696] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:46:19.903986 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-6df5f476-8df2-4f94-a069-e2fbccd720e2 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:46:19.904778 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-6df5f476-8df2-4f94-a069-e2fbccd720e2 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:46:19.905502 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-6df5f476-8df2-4f94-a069-e2fbccd720e2 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:46:19.906693 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-6df5f476-8df2-4f94-a069-e2fbccd720e2 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:46:19.907840 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-6df5f476-8df2-4f94-a069-e2fbccd720e2 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:46:19.908550 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-6df5f476-8df2-4f94-a069-e2fbccd720e2 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:46:20.051554 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-6df5f476-8df2-4f94-a069-e2fbccd720e2 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ec3d4f006c4f8f815b0cad9f933208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c52563210cf435696f3e3ae3907b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:46:20.059739 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-6df5f476-8df2-4f94-a069-e2fbccd720e2 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] 10.222.0.23 "GET /compute/v2.1/servers/af4e30b5-ee16-477c-8d6a-8fabf4fc7696" status: 200 len: 1264 microversion: 2.1 time: 0.174464 Sep 09 16:46:20.060315 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 532/1076] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:46:19 2022] GET /compute/v2.1/servers/af4e30b5-ee16-477c-8d6a-8fabf4fc7696 => generated 1264 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:46:21.086629 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-deeb2640-77ba-4b21-a6e9-b59309b67c5d tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:46:21.087236 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-deeb2640-77ba-4b21-a6e9-b59309b67c5d tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] [instance: af4e30b5-ee16-477c-8d6a-8fabf4fc7696] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:46:21.089111 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell0:SELECT=2 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:46:21.095219 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-deeb2640-77ba-4b21-a6e9-b59309b67c5d tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:46:21.095701 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-deeb2640-77ba-4b21-a6e9-b59309b67c5d tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:46:21.096135 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-deeb2640-77ba-4b21-a6e9-b59309b67c5d tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:46:21.096827 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-deeb2640-77ba-4b21-a6e9-b59309b67c5d tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:46:21.097281 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-deeb2640-77ba-4b21-a6e9-b59309b67c5d tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:46:21.097735 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-deeb2640-77ba-4b21-a6e9-b59309b67c5d tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:46:21.229338 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-deeb2640-77ba-4b21-a6e9-b59309b67c5d tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ec3d4f006c4f8f815b0cad9f933208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c52563210cf435696f3e3ae3907b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:46:21.237591 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-deeb2640-77ba-4b21-a6e9-b59309b67c5d tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] 10.222.0.23 "GET /compute/v2.1/servers/af4e30b5-ee16-477c-8d6a-8fabf4fc7696" status: 200 len: 1264 microversion: 2.1 time: 0.157540 Sep 09 16:46:21.238157 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 545/1077] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:46:21 2022] GET /compute/v2.1/servers/af4e30b5-ee16-477c-8d6a-8fabf4fc7696 => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:46:22.264886 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-82780b87-5298-4bd5-b6cf-afa35aa9ff75 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:46:22.265914 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-82780b87-5298-4bd5-b6cf-afa35aa9ff75 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] [instance: af4e30b5-ee16-477c-8d6a-8fabf4fc7696] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:46:22.269657 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG dbcounter [-] [127196] Writing DB stats nova_cell0:SELECT=4 {{(pid=127196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:46:22.279403 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-82780b87-5298-4bd5-b6cf-afa35aa9ff75 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:46:22.280203 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-82780b87-5298-4bd5-b6cf-afa35aa9ff75 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:46:22.280945 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-82780b87-5298-4bd5-b6cf-afa35aa9ff75 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:46:22.282480 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-82780b87-5298-4bd5-b6cf-afa35aa9ff75 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:46:22.283292 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-82780b87-5298-4bd5-b6cf-afa35aa9ff75 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:46:22.284002 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-82780b87-5298-4bd5-b6cf-afa35aa9ff75 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:46:22.416606 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-82780b87-5298-4bd5-b6cf-afa35aa9ff75 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ec3d4f006c4f8f815b0cad9f933208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c52563210cf435696f3e3ae3907b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:46:22.424477 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-82780b87-5298-4bd5-b6cf-afa35aa9ff75 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] 10.222.0.23 "GET /compute/v2.1/servers/af4e30b5-ee16-477c-8d6a-8fabf4fc7696" status: 200 len: 1264 microversion: 2.1 time: 0.166332 Sep 09 16:46:22.425049 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 533/1078] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:46:22 2022] GET /compute/v2.1/servers/af4e30b5-ee16-477c-8d6a-8fabf4fc7696 => generated 1264 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:46:23.451416 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-adfddc52-236f-4bcf-9394-76a5e6d866c7 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:46:23.452494 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-adfddc52-236f-4bcf-9394-76a5e6d866c7 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] [instance: af4e30b5-ee16-477c-8d6a-8fabf4fc7696] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:46:23.456038 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell0:SELECT=10 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:46:23.464174 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-adfddc52-236f-4bcf-9394-76a5e6d866c7 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:46:23.464825 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-adfddc52-236f-4bcf-9394-76a5e6d866c7 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:46:23.465417 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-adfddc52-236f-4bcf-9394-76a5e6d866c7 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:46:23.466357 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-adfddc52-236f-4bcf-9394-76a5e6d866c7 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:46:23.466945 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-adfddc52-236f-4bcf-9394-76a5e6d866c7 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:46:23.467416 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-adfddc52-236f-4bcf-9394-76a5e6d866c7 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:46:23.622483 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-adfddc52-236f-4bcf-9394-76a5e6d866c7 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ec3d4f006c4f8f815b0cad9f933208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c52563210cf435696f3e3ae3907b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:46:23.630486 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-adfddc52-236f-4bcf-9394-76a5e6d866c7 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] 10.222.0.23 "GET /compute/v2.1/servers/af4e30b5-ee16-477c-8d6a-8fabf4fc7696" status: 200 len: 1264 microversion: 2.1 time: 0.185578 Sep 09 16:46:23.631082 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 546/1079] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:46:23 2022] GET /compute/v2.1/servers/af4e30b5-ee16-477c-8d6a-8fabf4fc7696 => generated 1264 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:46:24.655205 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-e2ff6446-0d8a-4f88-9e04-e15cb880f42b tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:46:24.655832 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-e2ff6446-0d8a-4f88-9e04-e15cb880f42b tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] [instance: af4e30b5-ee16-477c-8d6a-8fabf4fc7696] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:46:24.663959 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e2ff6446-0d8a-4f88-9e04-e15cb880f42b tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:46:24.664578 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e2ff6446-0d8a-4f88-9e04-e15cb880f42b tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:46:24.665041 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e2ff6446-0d8a-4f88-9e04-e15cb880f42b tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:46:24.665734 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e2ff6446-0d8a-4f88-9e04-e15cb880f42b tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:46:24.666202 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e2ff6446-0d8a-4f88-9e04-e15cb880f42b tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:46:24.666649 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-e2ff6446-0d8a-4f88-9e04-e15cb880f42b tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:46:24.811793 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-e2ff6446-0d8a-4f88-9e04-e15cb880f42b tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ec3d4f006c4f8f815b0cad9f933208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c52563210cf435696f3e3ae3907b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:46:24.824017 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-e2ff6446-0d8a-4f88-9e04-e15cb880f42b tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] 10.222.0.23 "GET /compute/v2.1/servers/af4e30b5-ee16-477c-8d6a-8fabf4fc7696" status: 200 len: 1264 microversion: 2.1 time: 0.173148 Sep 09 16:46:24.824770 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 534/1080] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:46:24 2022] GET /compute/v2.1/servers/af4e30b5-ee16-477c-8d6a-8fabf4fc7696 => generated 1264 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:46:25.853312 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-96a38419-9d96-44e5-868c-7595fe76c110 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:46:25.853915 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-96a38419-9d96-44e5-868c-7595fe76c110 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] [instance: af4e30b5-ee16-477c-8d6a-8fabf4fc7696] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:46:25.860683 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-96a38419-9d96-44e5-868c-7595fe76c110 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:46:25.861159 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-96a38419-9d96-44e5-868c-7595fe76c110 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:46:25.861581 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-96a38419-9d96-44e5-868c-7595fe76c110 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:46:25.862267 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-96a38419-9d96-44e5-868c-7595fe76c110 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:46:25.862759 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-96a38419-9d96-44e5-868c-7595fe76c110 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:46:25.863177 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-96a38419-9d96-44e5-868c-7595fe76c110 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:46:26.000544 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-96a38419-9d96-44e5-868c-7595fe76c110 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ec3d4f006c4f8f815b0cad9f933208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c52563210cf435696f3e3ae3907b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:46:26.011363 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-96a38419-9d96-44e5-868c-7595fe76c110 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] 10.222.0.23 "GET /compute/v2.1/servers/af4e30b5-ee16-477c-8d6a-8fabf4fc7696" status: 200 len: 1264 microversion: 2.1 time: 0.164304 Sep 09 16:46:26.011924 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 547/1081] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:46:25 2022] GET /compute/v2.1/servers/af4e30b5-ee16-477c-8d6a-8fabf4fc7696 => generated 1264 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:46:27.034177 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-2f7fdaa4-eb67-426a-9f6a-91afeca31887 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:46:27.034927 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-2f7fdaa4-eb67-426a-9f6a-91afeca31887 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] [instance: af4e30b5-ee16-477c-8d6a-8fabf4fc7696] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:46:27.041780 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-2f7fdaa4-eb67-426a-9f6a-91afeca31887 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:46:27.042261 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-2f7fdaa4-eb67-426a-9f6a-91afeca31887 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:46:27.042725 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-2f7fdaa4-eb67-426a-9f6a-91afeca31887 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:46:27.043420 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-2f7fdaa4-eb67-426a-9f6a-91afeca31887 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:46:27.043865 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-2f7fdaa4-eb67-426a-9f6a-91afeca31887 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:46:27.044278 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-2f7fdaa4-eb67-426a-9f6a-91afeca31887 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:46:27.183358 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-2f7fdaa4-eb67-426a-9f6a-91afeca31887 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ec3d4f006c4f8f815b0cad9f933208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c52563210cf435696f3e3ae3907b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:46:27.191785 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-2f7fdaa4-eb67-426a-9f6a-91afeca31887 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] 10.222.0.23 "GET /compute/v2.1/servers/af4e30b5-ee16-477c-8d6a-8fabf4fc7696" status: 200 len: 1264 microversion: 2.1 time: 0.162262 Sep 09 16:46:27.192368 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 535/1082] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:46:27 2022] GET /compute/v2.1/servers/af4e30b5-ee16-477c-8d6a-8fabf4fc7696 => generated 1264 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:46:27.263433 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [req-c21e41d7-3e55-4f17-965c-c42e6271e90a req-30f14dc1-2505-41d3-85d7-0eeb4b997527 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af4e30b5-ee16-477c-8d6a-8fabf4fc7696", "name": "network-vif-plugged", "status": "completed", "tag": "71e424e1-c604-42d0-b606-e08bedda19a0"}]} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:46:27.273579 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-c21e41d7-3e55-4f17-965c-c42e6271e90a req-30f14dc1-2505-41d3-85d7-0eeb4b997527 service nova] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:46:27.274054 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-c21e41d7-3e55-4f17-965c-c42e6271e90a req-30f14dc1-2505-41d3-85d7-0eeb4b997527 service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:46:27.274603 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-c21e41d7-3e55-4f17-965c-c42e6271e90a req-30f14dc1-2505-41d3-85d7-0eeb4b997527 service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:46:27.286121 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.compute.server_external_events [req-c21e41d7-3e55-4f17-965c-c42e6271e90a req-30f14dc1-2505-41d3-85d7-0eeb4b997527 service nova] Creating event network-vif-plugged:71e424e1-c604-42d0-b606-e08bedda19a0 for instance af4e30b5-ee16-477c-8d6a-8fabf4fc7696 on hv-cinder-83124 Sep 09 16:46:27.291320 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [req-c21e41d7-3e55-4f17-965c-c42e6271e90a req-30f14dc1-2505-41d3-85d7-0eeb4b997527 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031693 Sep 09 16:46:27.291880 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 548/1083] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Sep 9 16:46:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:46:28.219315 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-6375881c-0987-4ffc-b809-ba7d9f9aa1ff tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:46:28.220332 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-6375881c-0987-4ffc-b809-ba7d9f9aa1ff tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] [instance: af4e30b5-ee16-477c-8d6a-8fabf4fc7696] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:46:28.230256 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-6375881c-0987-4ffc-b809-ba7d9f9aa1ff tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:46:28.230809 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-6375881c-0987-4ffc-b809-ba7d9f9aa1ff tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:46:28.231277 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-6375881c-0987-4ffc-b809-ba7d9f9aa1ff tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:46:28.231976 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-6375881c-0987-4ffc-b809-ba7d9f9aa1ff tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:46:28.232439 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-6375881c-0987-4ffc-b809-ba7d9f9aa1ff tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:46:28.232864 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-6375881c-0987-4ffc-b809-ba7d9f9aa1ff tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:46:28.372265 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-6375881c-0987-4ffc-b809-ba7d9f9aa1ff tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ec3d4f006c4f8f815b0cad9f933208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c52563210cf435696f3e3ae3907b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:46:28.380436 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-6375881c-0987-4ffc-b809-ba7d9f9aa1ff tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] 10.222.0.23 "GET /compute/v2.1/servers/af4e30b5-ee16-477c-8d6a-8fabf4fc7696" status: 200 len: 1264 microversion: 2.1 time: 0.167835 Sep 09 16:46:28.381014 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 536/1084] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:46:28 2022] GET /compute/v2.1/servers/af4e30b5-ee16-477c-8d6a-8fabf4fc7696 => generated 1264 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:46:29.411783 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-cc8e2544-62fb-401b-8b05-93e6a6d96e86 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:46:29.412629 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-cc8e2544-62fb-401b-8b05-93e6a6d96e86 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] [instance: af4e30b5-ee16-477c-8d6a-8fabf4fc7696] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:46:29.423233 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cc8e2544-62fb-401b-8b05-93e6a6d96e86 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:46:29.423938 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cc8e2544-62fb-401b-8b05-93e6a6d96e86 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:46:29.424553 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cc8e2544-62fb-401b-8b05-93e6a6d96e86 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:46:29.425576 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cc8e2544-62fb-401b-8b05-93e6a6d96e86 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:46:29.426213 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cc8e2544-62fb-401b-8b05-93e6a6d96e86 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:46:29.426869 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cc8e2544-62fb-401b-8b05-93e6a6d96e86 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:46:29.563781 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-cc8e2544-62fb-401b-8b05-93e6a6d96e86 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ec3d4f006c4f8f815b0cad9f933208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c52563210cf435696f3e3ae3907b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:46:29.574746 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-cc8e2544-62fb-401b-8b05-93e6a6d96e86 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] 10.222.0.23 "GET /compute/v2.1/servers/af4e30b5-ee16-477c-8d6a-8fabf4fc7696" status: 200 len: 1451 microversion: 2.1 time: 0.173552 Sep 09 16:46:29.575299 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 549/1085] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:46:29 2022] GET /compute/v2.1/servers/af4e30b5-ee16-477c-8d6a-8fabf4fc7696 => generated 1451 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:46:29.597045 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-ea04f5d6-8fed-48ab-9aa5-8630c1665fa2 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:46:29.597754 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-ea04f5d6-8fed-48ab-9aa5-8630c1665fa2 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] [instance: af4e30b5-ee16-477c-8d6a-8fabf4fc7696] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:46:29.605017 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-ea04f5d6-8fed-48ab-9aa5-8630c1665fa2 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:46:29.605558 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-ea04f5d6-8fed-48ab-9aa5-8630c1665fa2 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:46:29.606022 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-ea04f5d6-8fed-48ab-9aa5-8630c1665fa2 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:46:29.606946 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-ea04f5d6-8fed-48ab-9aa5-8630c1665fa2 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:46:29.607427 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-ea04f5d6-8fed-48ab-9aa5-8630c1665fa2 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:46:29.607913 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-ea04f5d6-8fed-48ab-9aa5-8630c1665fa2 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:46:29.747774 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-ea04f5d6-8fed-48ab-9aa5-8630c1665fa2 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ec3d4f006c4f8f815b0cad9f933208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c52563210cf435696f3e3ae3907b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:46:29.760242 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-ea04f5d6-8fed-48ab-9aa5-8630c1665fa2 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] 10.222.0.23 "GET /compute/v2.1/servers/af4e30b5-ee16-477c-8d6a-8fabf4fc7696" status: 200 len: 1451 microversion: 2.1 time: 0.167143 Sep 09 16:46:29.760809 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 537/1086] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:46:29 2022] GET /compute/v2.1/servers/af4e30b5-ee16-477c-8d6a-8fabf4fc7696 => generated 1451 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:46:31.441529 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [req-ecb1f240-ff21-40ad-a11b-f0615e4bc8dc req-8880ba2a-57c4-4111-a3db-4855a464aab1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af4e30b5-ee16-477c-8d6a-8fabf4fc7696", "tag": "71e424e1-c604-42d0-b606-e08bedda19a0"}]} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:46:31.451541 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-ecb1f240-ff21-40ad-a11b-f0615e4bc8dc req-8880ba2a-57c4-4111-a3db-4855a464aab1 service nova] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:46:31.452034 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-ecb1f240-ff21-40ad-a11b-f0615e4bc8dc req-8880ba2a-57c4-4111-a3db-4855a464aab1 service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:46:31.452456 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-ecb1f240-ff21-40ad-a11b-f0615e4bc8dc req-8880ba2a-57c4-4111-a3db-4855a464aab1 service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:46:31.465721 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.compute.server_external_events [req-ecb1f240-ff21-40ad-a11b-f0615e4bc8dc req-8880ba2a-57c4-4111-a3db-4855a464aab1 service nova] Creating event network-changed:71e424e1-c604-42d0-b606-e08bedda19a0 for instance af4e30b5-ee16-477c-8d6a-8fabf4fc7696 on hv-cinder-83124 Sep 09 16:46:31.471194 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [req-ecb1f240-ff21-40ad-a11b-f0615e4bc8dc req-8880ba2a-57c4-4111-a3db-4855a464aab1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089331 Sep 09 16:46:31.471822 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 550/1087] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Sep 9 16:46:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:48:03.342393 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:48:03.343092 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-1caaf863-40e7-4a66-bafc-f6c5bdf699e0 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:48:03.343092 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-1caaf863-40e7-4a66-bafc-f6c5bdf699e0 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] [instance: af4e30b5-ee16-477c-8d6a-8fabf4fc7696] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:48:03.343840 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell1:SELECT=48 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:48:03.344948 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 09 16:48:03.345329 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Fri Sep 9 16:48:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.23) !!! Sep 09 16:48:03.345560 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG dbcounter [-] [127196] Writing DB stats nova_api:SELECT=26 {{(pid=127196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:48:03.349851 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG dbcounter [-] [127196] Writing DB stats nova_cell1:SELECT=50 {{(pid=127196) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:48:03.351230 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 09 16:48:03.351379 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Fri Sep 9 16:48:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/af4e30b5-ee16-477c-8d6a-8fabf4fc7696 (ip 10.222.0.23) !!! Sep 09 16:48:03.352483 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [req-b8274fe9-0fa0-4d3e-8e87-ac0afdfdd039 req-ed52215d-8556-417d-9a47-0e797dded08e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af4e30b5-ee16-477c-8d6a-8fabf4fc7696", "tag": "71e424e1-c604-42d0-b606-e08bedda19a0"}]} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:48:03.353776 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 09 16:48:03.353915 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Fri Sep 9 16:48:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/af4e30b5-ee16-477c-8d6a-8fabf4fc7696 (ip 10.222.0.23) !!! Sep 09 16:48:03.364134 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-b8274fe9-0fa0-4d3e-8e87-ac0afdfdd039 req-ed52215d-8556-417d-9a47-0e797dded08e service nova] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:48:03.364611 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-b8274fe9-0fa0-4d3e-8e87-ac0afdfdd039 req-ed52215d-8556-417d-9a47-0e797dded08e service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:48:03.365035 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-b8274fe9-0fa0-4d3e-8e87-ac0afdfdd039 req-ed52215d-8556-417d-9a47-0e797dded08e service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:48:03.374416 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-1caaf863-40e7-4a66-bafc-f6c5bdf699e0 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:48:03.374954 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-1caaf863-40e7-4a66-bafc-f6c5bdf699e0 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:48:03.375390 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-1caaf863-40e7-4a66-bafc-f6c5bdf699e0 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:48:03.376100 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-1caaf863-40e7-4a66-bafc-f6c5bdf699e0 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:48:03.376553 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-1caaf863-40e7-4a66-bafc-f6c5bdf699e0 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:48:03.376976 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-1caaf863-40e7-4a66-bafc-f6c5bdf699e0 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:48:03.377209 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.compute.server_external_events [req-b8274fe9-0fa0-4d3e-8e87-ac0afdfdd039 req-ed52215d-8556-417d-9a47-0e797dded08e service nova] Creating event network-changed:71e424e1-c604-42d0-b606-e08bedda19a0 for instance af4e30b5-ee16-477c-8d6a-8fabf4fc7696 on hv-cinder-83124 Sep 09 16:48:03.382189 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [req-b8274fe9-0fa0-4d3e-8e87-ac0afdfdd039 req-ed52215d-8556-417d-9a47-0e797dded08e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041874 Sep 09 16:48:03.383089 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 551/1088] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Sep 9 16:48:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:48:03.407794 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-1caaf863-40e7-4a66-bafc-f6c5bdf699e0 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] [instance: af4e30b5-ee16-477c-8d6a-8fabf4fc7696] Going to try to terminate instance {{(pid=127196) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 16:48:03.491997 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-1caaf863-40e7-4a66-bafc-f6c5bdf699e0 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] 10.222.0.23 "DELETE /compute/v2.1/servers/af4e30b5-ee16-477c-8d6a-8fabf4fc7696" status: 204 len: 0 microversion: 2.1 time: 0.154193 Sep 09 16:48:03.496833 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 538/1089] 10.222.0.23 () {58 vars in 1239 bytes} [Fri Sep 9 16:48:03 2022] DELETE /compute/v2.1/servers/af4e30b5-ee16-477c-8d6a-8fabf4fc7696 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 16:48:03.502892 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-a6076bb5-1d50-41b9-829f-400581a66b59 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:48:03.503932 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-a6076bb5-1d50-41b9-829f-400581a66b59 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] [instance: af4e30b5-ee16-477c-8d6a-8fabf4fc7696] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:48:03.511923 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a6076bb5-1d50-41b9-829f-400581a66b59 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:48:03.512419 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a6076bb5-1d50-41b9-829f-400581a66b59 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:48:03.512860 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a6076bb5-1d50-41b9-829f-400581a66b59 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:48:03.514034 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a6076bb5-1d50-41b9-829f-400581a66b59 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:48:03.514489 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a6076bb5-1d50-41b9-829f-400581a66b59 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:48:03.515432 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a6076bb5-1d50-41b9-829f-400581a66b59 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:48:03.699279 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-a6076bb5-1d50-41b9-829f-400581a66b59 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ec3d4f006c4f8f815b0cad9f933208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c52563210cf435696f3e3ae3907b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:48:03.707250 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-a6076bb5-1d50-41b9-829f-400581a66b59 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] 10.222.0.23 "GET /compute/v2.1/servers/af4e30b5-ee16-477c-8d6a-8fabf4fc7696" status: 200 len: 1576 microversion: 2.1 time: 0.209423 Sep 09 16:48:03.707826 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 552/1090] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:48:03 2022] GET /compute/v2.1/servers/af4e30b5-ee16-477c-8d6a-8fabf4fc7696 => generated 1576 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:48:04.731638 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-09a90729-f522-4d55-8f77-5a4b3c986efc tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:48:04.732363 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-09a90729-f522-4d55-8f77-5a4b3c986efc tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] [instance: af4e30b5-ee16-477c-8d6a-8fabf4fc7696] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:48:04.739167 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-09a90729-f522-4d55-8f77-5a4b3c986efc tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:48:04.739683 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-09a90729-f522-4d55-8f77-5a4b3c986efc tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:48:04.740115 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-09a90729-f522-4d55-8f77-5a4b3c986efc tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:48:04.740805 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-09a90729-f522-4d55-8f77-5a4b3c986efc tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:48:04.741235 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-09a90729-f522-4d55-8f77-5a4b3c986efc tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:48:04.741677 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-09a90729-f522-4d55-8f77-5a4b3c986efc tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:48:04.997226 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-09a90729-f522-4d55-8f77-5a4b3c986efc tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ec3d4f006c4f8f815b0cad9f933208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c52563210cf435696f3e3ae3907b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:48:05.008652 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-09a90729-f522-4d55-8f77-5a4b3c986efc tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] 10.222.0.23 "GET /compute/v2.1/servers/af4e30b5-ee16-477c-8d6a-8fabf4fc7696" status: 200 len: 1576 microversion: 2.1 time: 0.281427 Sep 09 16:48:05.009199 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 539/1091] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:48:04 2022] GET /compute/v2.1/servers/af4e30b5-ee16-477c-8d6a-8fabf4fc7696 => generated 1576 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:48:05.802363 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [req-66d9ca75-8644-4793-b1f4-3a9cea7658c6 req-0b7335f3-3007-42bf-aadd-6e284553f305 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af4e30b5-ee16-477c-8d6a-8fabf4fc7696", "name": "network-vif-deleted", "tag": "71e424e1-c604-42d0-b606-e08bedda19a0"}]} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:48:05.812538 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-66d9ca75-8644-4793-b1f4-3a9cea7658c6 req-0b7335f3-3007-42bf-aadd-6e284553f305 service nova] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:48:05.813006 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-66d9ca75-8644-4793-b1f4-3a9cea7658c6 req-0b7335f3-3007-42bf-aadd-6e284553f305 service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:48:05.813434 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-66d9ca75-8644-4793-b1f4-3a9cea7658c6 req-0b7335f3-3007-42bf-aadd-6e284553f305 service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:48:05.824997 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.compute.server_external_events [req-66d9ca75-8644-4793-b1f4-3a9cea7658c6 req-0b7335f3-3007-42bf-aadd-6e284553f305 service nova] Creating event network-vif-deleted:71e424e1-c604-42d0-b606-e08bedda19a0 for instance af4e30b5-ee16-477c-8d6a-8fabf4fc7696 on hv-cinder-83124 Sep 09 16:48:05.830318 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [req-66d9ca75-8644-4793-b1f4-3a9cea7658c6 req-0b7335f3-3007-42bf-aadd-6e284553f305 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031638 Sep 09 16:48:05.830940 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 553/1092] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Sep 9 16:48:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:48:06.037404 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-a17bf420-da37-4e6f-90a1-ac801b6e9762 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:48:06.039261 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-a17bf420-da37-4e6f-90a1-ac801b6e9762 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] [instance: af4e30b5-ee16-477c-8d6a-8fabf4fc7696] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:48:06.050329 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-a17bf420-da37-4e6f-90a1-ac801b6e9762 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:48:06.051316 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-a17bf420-da37-4e6f-90a1-ac801b6e9762 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:48:06.052049 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-a17bf420-da37-4e6f-90a1-ac801b6e9762 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:48:06.053206 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-a17bf420-da37-4e6f-90a1-ac801b6e9762 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:48:06.053945 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-a17bf420-da37-4e6f-90a1-ac801b6e9762 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:48:06.054829 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-a17bf420-da37-4e6f-90a1-ac801b6e9762 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:48:06.125872 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-a17bf420-da37-4e6f-90a1-ac801b6e9762 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ec3d4f006c4f8f815b0cad9f933208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c52563210cf435696f3e3ae3907b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:48:06.134231 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-a17bf420-da37-4e6f-90a1-ac801b6e9762 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] 10.222.0.23 "GET /compute/v2.1/servers/af4e30b5-ee16-477c-8d6a-8fabf4fc7696" status: 200 len: 1224 microversion: 2.1 time: 0.104681 Sep 09 16:48:06.135031 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 540/1093] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:48:06 2022] GET /compute/v2.1/servers/af4e30b5-ee16-477c-8d6a-8fabf4fc7696 => generated 1224 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:48:07.165351 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-8789d015-ed10-4c69-bd8d-cacabc1d94bf tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:48:07.166077 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-8789d015-ed10-4c69-bd8d-cacabc1d94bf tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] [instance: af4e30b5-ee16-477c-8d6a-8fabf4fc7696] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:48:07.172441 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8789d015-ed10-4c69-bd8d-cacabc1d94bf tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:48:07.172923 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8789d015-ed10-4c69-bd8d-cacabc1d94bf tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:48:07.173357 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8789d015-ed10-4c69-bd8d-cacabc1d94bf tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:48:07.174047 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8789d015-ed10-4c69-bd8d-cacabc1d94bf tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:48:07.174518 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8789d015-ed10-4c69-bd8d-cacabc1d94bf tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:48:07.174939 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8789d015-ed10-4c69-bd8d-cacabc1d94bf tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:48:07.188474 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.wsgi [None req-8789d015-ed10-4c69-bd8d-cacabc1d94bf tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] HTTP exception thrown: Instance af4e30b5-ee16-477c-8d6a-8fabf4fc7696 could not be found. Sep 09 16:48:07.190139 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-8789d015-ed10-4c69-bd8d-cacabc1d94bf tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Request method failure captured: Sep 09 16:48:07.190139 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: request: GET /compute/v2.1/servers/af4e30b5-ee16-477c-8d6a-8fabf4fc7696 HTTP/1.1 Sep 09 16:48:07.190139 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Accept: application/json Sep 09 16:48:07.190139 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Accept-Encoding: identity Sep 09 16:48:07.190139 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Connection: close Sep 09 16:48:07.190139 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Content-Length: 0 Sep 09 16:48:07.190139 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Content-Type: application/json Sep 09 16:48:07.190139 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Host: 10.222.0.23 Sep 09 16:48:07.190139 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Openstack-System-Scope: None Sep 09 16:48:07.190139 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: User-Agent: python-urllib3/1.26.12 Sep 09 16:48:07.190139 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Auth-Token: gAAAAABjG2zA2C3Urjs5rX1aJ4LKhkL3u9nZn6jfJf116bnd56Qt97VVQ7ocGpj0lL75heJHPdN6Cw3P9LXL57icrantDpvxWBIY8Uq_2L9Afi5dh46vkZJCYW06kaJAfmsx1WEU03C9lzGI0XC3nzAEIQPaqhPRx8PWaHcRcTSHjYzjfP4jc6o Sep 09 16:48:07.190139 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Domain-Id: None Sep 09 16:48:07.190139 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Domain-Name: None Sep 09 16:48:07.190139 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Identity-Status: Confirmed Sep 09 16:48:07.190139 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Is-Admin-Project: True Sep 09 16:48:07.190139 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Project-Domain-Id: default Sep 09 16:48:07.190139 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Project-Domain-Name: Default Sep 09 16:48:07.190139 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Project-Id: 5c52563210cf435696f3e3ae3907b0fb Sep 09 16:48:07.190139 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Project-Name: tempest-TestVolumeBootPattern-44960866 Sep 09 16:48:07.190139 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Role: member,reader Sep 09 16:48:07.190139 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Roles: member,reader Sep 09 16:48:07.191754 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5c52563210cf435696f3e3ae3907b0fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/5c52563210cf435696f3e3ae3907b0fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5c52563210cf435696f3e3ae3907b0fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_5c52563210cf435696f3e3ae3907b0fb"}]}] Sep 09 16:48:07.191754 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Tenant: tempest-TestVolumeBootPattern-44960866 Sep 09 16:48:07.191754 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Tenant-Id: 5c52563210cf435696f3e3ae3907b0fb Sep 09 16:48:07.191754 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Tenant-Name: tempest-TestVolumeBootPattern-44960866 Sep 09 16:48:07.191754 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User: tempest-TestVolumeBootPattern-44960866-project Sep 09 16:48:07.191754 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User-Domain-Id: default Sep 09 16:48:07.191754 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User-Domain-Name: Default Sep 09 16:48:07.191754 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User-Id: 69ec3d4f006c4f8f815b0cad9f933208 Sep 09 16:48:07.191754 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User-Name: tempest-TestVolumeBootPattern-44960866-project Sep 09 16:48:07.191754 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: method: > Sep 09 16:48:07.191754 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: exception: Instance af4e30b5-ee16-477c-8d6a-8fabf4fc7696 could not be found. Sep 09 16:48:07.191754 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: action_args: {'id': 'af4e30b5-ee16-477c-8d6a-8fabf4fc7696'} Sep 09 16:48:07.192640 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 16:48:07.192640 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:48:07.192640 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 16:48:07.192640 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 16:48:07.192640 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 16:48:07.192640 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 16:48:07.192640 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 16:48:07.192640 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 16:48:07.192640 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 16:48:07.192640 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 16:48:07.192640 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af4e30b5-ee16-477c-8d6a-8fabf4fc7696 could not be found. Sep 09 16:48:07.192640 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:48:07.192640 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 16:48:07.192640 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:48:07.192640 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:48:07.192640 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 16:48:07.192640 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 16:48:07.192640 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 16:48:07.192640 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 16:48:07.192640 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 16:48:07.194283 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 16:48:07.194283 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 16:48:07.194283 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 16:48:07.194283 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 16:48:07.194283 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 16:48:07.194283 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 16:48:07.194283 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 16:48:07.194283 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af4e30b5-ee16-477c-8d6a-8fabf4fc7696 could not be found. Sep 09 16:48:07.194283 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:48:07.194283 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 16:48:07.194283 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:48:07.194283 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:48:07.194283 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 16:48:07.194283 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 16:48:07.194283 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 16:48:07.194283 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 16:48:07.194283 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af4e30b5-ee16-477c-8d6a-8fabf4fc7696 could not be found. Sep 09 16:48:07.194283 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:48:07.195828 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-8789d015-ed10-4c69-bd8d-cacabc1d94bf tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Returning 404 to user: Instance af4e30b5-ee16-477c-8d6a-8fabf4fc7696 could not be found. {{(pid=127198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 16:48:07.195828 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-8789d015-ed10-4c69-bd8d-cacabc1d94bf tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] 10.222.0.23 "GET /compute/v2.1/servers/af4e30b5-ee16-477c-8d6a-8fabf4fc7696" status: 404 len: 111 microversion: 2.1 time: 0.033437 Sep 09 16:48:07.195828 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 554/1094] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:48:07 2022] GET /compute/v2.1/servers/af4e30b5-ee16-477c-8d6a-8fabf4fc7696 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 16:48:10.550680 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-eb454ba8-a2da-4bb4-8c30-897426d6f538 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:48:10.551764 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-eb454ba8-a2da-4bb4-8c30-897426d6f538 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] [instance: ceecb9dd-9cdc-4d73-afdc-9392417e0b36] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:48:10.552719 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [req-e2323405-cd3c-417b-9aa4-63a7b3801ca6 req-3a1a1341-7143-4d55-bd31-1905e51b5487 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ceecb9dd-9cdc-4d73-afdc-9392417e0b36", "tag": "2e31f866-d5cb-4860-b630-ec38d3ce3f6b"}]} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:48:10.558472 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-eb454ba8-a2da-4bb4-8c30-897426d6f538 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:48:10.558986 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-eb454ba8-a2da-4bb4-8c30-897426d6f538 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:48:10.559529 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-eb454ba8-a2da-4bb4-8c30-897426d6f538 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:48:10.560286 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-eb454ba8-a2da-4bb4-8c30-897426d6f538 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:48:10.560745 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-eb454ba8-a2da-4bb4-8c30-897426d6f538 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:48:10.561168 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-eb454ba8-a2da-4bb4-8c30-897426d6f538 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:48:10.563477 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-e2323405-cd3c-417b-9aa4-63a7b3801ca6 req-3a1a1341-7143-4d55-bd31-1905e51b5487 service nova] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:48:10.564189 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-e2323405-cd3c-417b-9aa4-63a7b3801ca6 req-3a1a1341-7143-4d55-bd31-1905e51b5487 service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:48:10.564611 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-e2323405-cd3c-417b-9aa4-63a7b3801ca6 req-3a1a1341-7143-4d55-bd31-1905e51b5487 service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:48:10.576275 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.compute.server_external_events [req-e2323405-cd3c-417b-9aa4-63a7b3801ca6 req-3a1a1341-7143-4d55-bd31-1905e51b5487 service nova] Creating event network-changed:2e31f866-d5cb-4860-b630-ec38d3ce3f6b for instance ceecb9dd-9cdc-4d73-afdc-9392417e0b36 on hv-cinder-83124 Sep 09 16:48:10.581912 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [req-e2323405-cd3c-417b-9aa4-63a7b3801ca6 req-3a1a1341-7143-4d55-bd31-1905e51b5487 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032865 Sep 09 16:48:10.582573 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 555/1095] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Sep 9 16:48:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:48:10.587841 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-eb454ba8-a2da-4bb4-8c30-897426d6f538 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] [instance: ceecb9dd-9cdc-4d73-afdc-9392417e0b36] Going to try to terminate instance {{(pid=127196) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 16:48:10.674339 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-eb454ba8-a2da-4bb4-8c30-897426d6f538 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ceecb9dd-9cdc-4d73-afdc-9392417e0b36" status: 204 len: 0 microversion: 2.1 time: 0.127487 Sep 09 16:48:10.675690 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 541/1096] 10.222.0.23 () {58 vars in 1239 bytes} [Fri Sep 9 16:48:10 2022] DELETE /compute/v2.1/servers/ceecb9dd-9cdc-4d73-afdc-9392417e0b36 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 16:48:10.684748 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-ce51af47-e9c1-44c0-b2cc-86de44e43896 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:48:10.685437 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-ce51af47-e9c1-44c0-b2cc-86de44e43896 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] [instance: ceecb9dd-9cdc-4d73-afdc-9392417e0b36] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:48:10.691707 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ce51af47-e9c1-44c0-b2cc-86de44e43896 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:48:10.692428 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ce51af47-e9c1-44c0-b2cc-86de44e43896 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:48:10.693029 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ce51af47-e9c1-44c0-b2cc-86de44e43896 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:48:10.693905 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ce51af47-e9c1-44c0-b2cc-86de44e43896 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:48:10.694533 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ce51af47-e9c1-44c0-b2cc-86de44e43896 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:48:10.695108 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ce51af47-e9c1-44c0-b2cc-86de44e43896 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:48:10.828291 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-ce51af47-e9c1-44c0-b2cc-86de44e43896 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ec3d4f006c4f8f815b0cad9f933208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c52563210cf435696f3e3ae3907b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:48:10.836087 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-ce51af47-e9c1-44c0-b2cc-86de44e43896 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] 10.222.0.23 "GET /compute/v2.1/servers/ceecb9dd-9cdc-4d73-afdc-9392417e0b36" status: 200 len: 1576 microversion: 2.1 time: 0.155802 Sep 09 16:48:10.836984 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 556/1097] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:48:10 2022] GET /compute/v2.1/servers/ceecb9dd-9cdc-4d73-afdc-9392417e0b36 => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:48:11.865029 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-77e03432-f17a-4d5c-ae2d-631f45a0bcb3 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:48:11.867395 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-77e03432-f17a-4d5c-ae2d-631f45a0bcb3 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] [instance: ceecb9dd-9cdc-4d73-afdc-9392417e0b36] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:48:11.875704 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-77e03432-f17a-4d5c-ae2d-631f45a0bcb3 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:48:11.876191 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-77e03432-f17a-4d5c-ae2d-631f45a0bcb3 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:48:11.876624 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-77e03432-f17a-4d5c-ae2d-631f45a0bcb3 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:48:11.877325 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-77e03432-f17a-4d5c-ae2d-631f45a0bcb3 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:48:11.877773 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-77e03432-f17a-4d5c-ae2d-631f45a0bcb3 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:48:11.878194 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-77e03432-f17a-4d5c-ae2d-631f45a0bcb3 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:48:12.016839 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-77e03432-f17a-4d5c-ae2d-631f45a0bcb3 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ec3d4f006c4f8f815b0cad9f933208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c52563210cf435696f3e3ae3907b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:48:12.028248 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-77e03432-f17a-4d5c-ae2d-631f45a0bcb3 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] 10.222.0.23 "GET /compute/v2.1/servers/ceecb9dd-9cdc-4d73-afdc-9392417e0b36" status: 200 len: 1576 microversion: 2.1 time: 0.170658 Sep 09 16:48:12.028915 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 542/1098] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:48:11 2022] GET /compute/v2.1/servers/ceecb9dd-9cdc-4d73-afdc-9392417e0b36 => generated 1576 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:48:12.612295 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [req-c028b2f1-2385-421d-b815-a8f09564ffbc req-d7f96d6e-f601-414b-8345-1cff06302409 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ceecb9dd-9cdc-4d73-afdc-9392417e0b36", "name": "network-vif-deleted", "tag": "2e31f866-d5cb-4860-b630-ec38d3ce3f6b"}]} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 16:48:12.623153 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-c028b2f1-2385-421d-b815-a8f09564ffbc req-d7f96d6e-f601-414b-8345-1cff06302409 service nova] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:48:12.623622 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-c028b2f1-2385-421d-b815-a8f09564ffbc req-d7f96d6e-f601-414b-8345-1cff06302409 service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:48:12.624024 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-c028b2f1-2385-421d-b815-a8f09564ffbc req-d7f96d6e-f601-414b-8345-1cff06302409 service nova] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:48:12.635787 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.compute.server_external_events [req-c028b2f1-2385-421d-b815-a8f09564ffbc req-d7f96d6e-f601-414b-8345-1cff06302409 service nova] Creating event network-vif-deleted:2e31f866-d5cb-4860-b630-ec38d3ce3f6b for instance ceecb9dd-9cdc-4d73-afdc-9392417e0b36 on hv-cinder-83124 Sep 09 16:48:12.640762 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [req-c028b2f1-2385-421d-b815-a8f09564ffbc req-d7f96d6e-f601-414b-8345-1cff06302409 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032222 Sep 09 16:48:12.641366 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 557/1099] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Sep 9 16:48:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 16:48:13.053542 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-cca699a0-ae72-4464-9298-e75d543d3456 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:48:13.054172 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-cca699a0-ae72-4464-9298-e75d543d3456 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] [instance: ceecb9dd-9cdc-4d73-afdc-9392417e0b36] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:48:13.060849 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-cca699a0-ae72-4464-9298-e75d543d3456 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:48:13.061330 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-cca699a0-ae72-4464-9298-e75d543d3456 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:48:13.061763 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-cca699a0-ae72-4464-9298-e75d543d3456 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:48:13.062453 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-cca699a0-ae72-4464-9298-e75d543d3456 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:48:13.062965 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-cca699a0-ae72-4464-9298-e75d543d3456 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:48:13.063390 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-cca699a0-ae72-4464-9298-e75d543d3456 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:48:13.098268 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-cca699a0-ae72-4464-9298-e75d543d3456 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:48:13.098776 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-cca699a0-ae72-4464-9298-e75d543d3456 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:48:13.099221 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-cca699a0-ae72-4464-9298-e75d543d3456 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:48:13.099670 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.objects.instance [None req-cca699a0-ae72-4464-9298-e75d543d3456 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lazy-loading 'fault' on Instance uuid ceecb9dd-9cdc-4d73-afdc-9392417e0b36 {{(pid=127196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 16:48:13.152830 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.policy [None req-cca699a0-ae72-4464-9298-e75d543d3456 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ec3d4f006c4f8f815b0cad9f933208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c52563210cf435696f3e3ae3907b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127196) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 16:48:13.161420 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-cca699a0-ae72-4464-9298-e75d543d3456 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] 10.222.0.23 "GET /compute/v2.1/servers/ceecb9dd-9cdc-4d73-afdc-9392417e0b36" status: 200 len: 1229 microversion: 2.1 time: 0.111823 Sep 09 16:48:13.162205 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 543/1100] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:48:13 2022] GET /compute/v2.1/servers/ceecb9dd-9cdc-4d73-afdc-9392417e0b36 => generated 1229 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 16:48:14.186303 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-a77dcd3d-9d5b-4e5a-bccf-1eb5eb2637fd tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:48:14.187035 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-a77dcd3d-9d5b-4e5a-bccf-1eb5eb2637fd tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] [instance: ceecb9dd-9cdc-4d73-afdc-9392417e0b36] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:48:14.193675 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a77dcd3d-9d5b-4e5a-bccf-1eb5eb2637fd tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:48:14.194158 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a77dcd3d-9d5b-4e5a-bccf-1eb5eb2637fd tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:48:14.194632 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a77dcd3d-9d5b-4e5a-bccf-1eb5eb2637fd tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:48:14.195326 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a77dcd3d-9d5b-4e5a-bccf-1eb5eb2637fd tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:48:14.195783 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a77dcd3d-9d5b-4e5a-bccf-1eb5eb2637fd tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:48:14.196205 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a77dcd3d-9d5b-4e5a-bccf-1eb5eb2637fd tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:48:14.209684 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.wsgi [None req-a77dcd3d-9d5b-4e5a-bccf-1eb5eb2637fd tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] HTTP exception thrown: Instance ceecb9dd-9cdc-4d73-afdc-9392417e0b36 could not be found. Sep 09 16:48:14.211370 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-a77dcd3d-9d5b-4e5a-bccf-1eb5eb2637fd tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Request method failure captured: Sep 09 16:48:14.211370 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: request: GET /compute/v2.1/servers/ceecb9dd-9cdc-4d73-afdc-9392417e0b36 HTTP/1.1 Sep 09 16:48:14.211370 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Accept: application/json Sep 09 16:48:14.211370 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Accept-Encoding: identity Sep 09 16:48:14.211370 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Connection: close Sep 09 16:48:14.211370 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Content-Length: 0 Sep 09 16:48:14.211370 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Content-Type: application/json Sep 09 16:48:14.211370 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Host: 10.222.0.23 Sep 09 16:48:14.211370 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Openstack-System-Scope: None Sep 09 16:48:14.211370 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: User-Agent: python-urllib3/1.26.12 Sep 09 16:48:14.211370 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Auth-Token: gAAAAABjG2zA2C3Urjs5rX1aJ4LKhkL3u9nZn6jfJf116bnd56Qt97VVQ7ocGpj0lL75heJHPdN6Cw3P9LXL57icrantDpvxWBIY8Uq_2L9Afi5dh46vkZJCYW06kaJAfmsx1WEU03C9lzGI0XC3nzAEIQPaqhPRx8PWaHcRcTSHjYzjfP4jc6o Sep 09 16:48:14.211370 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Domain-Id: None Sep 09 16:48:14.211370 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Domain-Name: None Sep 09 16:48:14.211370 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Identity-Status: Confirmed Sep 09 16:48:14.211370 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Is-Admin-Project: True Sep 09 16:48:14.211370 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Project-Domain-Id: default Sep 09 16:48:14.211370 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Project-Domain-Name: Default Sep 09 16:48:14.211370 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Project-Id: 5c52563210cf435696f3e3ae3907b0fb Sep 09 16:48:14.211370 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Project-Name: tempest-TestVolumeBootPattern-44960866 Sep 09 16:48:14.211370 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Role: member,reader Sep 09 16:48:14.211370 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Roles: member,reader Sep 09 16:48:14.213053 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5c52563210cf435696f3e3ae3907b0fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/5c52563210cf435696f3e3ae3907b0fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5c52563210cf435696f3e3ae3907b0fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_5c52563210cf435696f3e3ae3907b0fb"}]}] Sep 09 16:48:14.213053 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Tenant: tempest-TestVolumeBootPattern-44960866 Sep 09 16:48:14.213053 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Tenant-Id: 5c52563210cf435696f3e3ae3907b0fb Sep 09 16:48:14.213053 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Tenant-Name: tempest-TestVolumeBootPattern-44960866 Sep 09 16:48:14.213053 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User: tempest-TestVolumeBootPattern-44960866-project Sep 09 16:48:14.213053 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User-Domain-Id: default Sep 09 16:48:14.213053 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User-Domain-Name: Default Sep 09 16:48:14.213053 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User-Id: 69ec3d4f006c4f8f815b0cad9f933208 Sep 09 16:48:14.213053 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User-Name: tempest-TestVolumeBootPattern-44960866-project Sep 09 16:48:14.213053 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: method: > Sep 09 16:48:14.213053 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: exception: Instance ceecb9dd-9cdc-4d73-afdc-9392417e0b36 could not be found. Sep 09 16:48:14.213053 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: action_args: {'id': 'ceecb9dd-9cdc-4d73-afdc-9392417e0b36'} Sep 09 16:48:14.214090 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 16:48:14.214090 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:48:14.214090 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 16:48:14.214090 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 16:48:14.214090 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 16:48:14.214090 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 16:48:14.214090 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 16:48:14.214090 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 16:48:14.214090 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 16:48:14.214090 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 16:48:14.214090 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ceecb9dd-9cdc-4d73-afdc-9392417e0b36 could not be found. Sep 09 16:48:14.214090 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:48:14.214090 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 16:48:14.214090 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:48:14.214090 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:48:14.214090 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 16:48:14.214090 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 16:48:14.214090 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 16:48:14.214090 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 16:48:14.214090 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 16:48:14.215747 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 16:48:14.215747 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 16:48:14.215747 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 16:48:14.215747 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 16:48:14.215747 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 16:48:14.215747 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 16:48:14.215747 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 16:48:14.215747 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ceecb9dd-9cdc-4d73-afdc-9392417e0b36 could not be found. Sep 09 16:48:14.215747 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:48:14.215747 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 16:48:14.215747 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:48:14.215747 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:48:14.215747 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 16:48:14.215747 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 16:48:14.215747 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 16:48:14.215747 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 16:48:14.215747 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ceecb9dd-9cdc-4d73-afdc-9392417e0b36 could not be found. Sep 09 16:48:14.215747 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:48:14.217377 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-a77dcd3d-9d5b-4e5a-bccf-1eb5eb2637fd tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Returning 404 to user: Instance ceecb9dd-9cdc-4d73-afdc-9392417e0b36 could not be found. {{(pid=127198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 16:48:14.217377 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-a77dcd3d-9d5b-4e5a-bccf-1eb5eb2637fd tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] 10.222.0.23 "GET /compute/v2.1/servers/ceecb9dd-9cdc-4d73-afdc-9392417e0b36" status: 404 len: 111 microversion: 2.1 time: 0.031461 Sep 09 16:48:14.217377 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 558/1101] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:48:14 2022] GET /compute/v2.1/servers/ceecb9dd-9cdc-4d73-afdc-9392417e0b36 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 16:48:14.668501 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-088a6a70-eff2-4863-a89a-aab1f254306a tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Calling method '>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:48:14.669151 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.compute.api [None req-088a6a70-eff2-4863-a89a-aab1f254306a tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] [instance: d4bd5be5-501a-42aa-b8ad-4f302c5d3c77] Fetching instance by UUID {{(pid=127196) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:48:14.675379 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-088a6a70-eff2-4863-a89a-aab1f254306a tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:48:14.675865 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-088a6a70-eff2-4863-a89a-aab1f254306a tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:48:14.676298 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-088a6a70-eff2-4863-a89a-aab1f254306a tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:48:14.677013 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-088a6a70-eff2-4863-a89a-aab1f254306a tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:48:14.677468 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-088a6a70-eff2-4863-a89a-aab1f254306a tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:48:14.677884 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG oslo_concurrency.lockutils [None req-088a6a70-eff2-4863-a89a-aab1f254306a tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:48:14.691359 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.wsgi [None req-088a6a70-eff2-4863-a89a-aab1f254306a tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] HTTP exception thrown: Instance d4bd5be5-501a-42aa-b8ad-4f302c5d3c77 could not be found. Sep 09 16:48:14.692999 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-088a6a70-eff2-4863-a89a-aab1f254306a tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Request method failure captured: Sep 09 16:48:14.692999 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: request: DELETE /compute/v2.1/servers/d4bd5be5-501a-42aa-b8ad-4f302c5d3c77 HTTP/1.1 Sep 09 16:48:14.692999 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Accept: application/json Sep 09 16:48:14.692999 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Accept-Encoding: identity Sep 09 16:48:14.692999 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Connection: close Sep 09 16:48:14.692999 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Content-Length: 0 Sep 09 16:48:14.692999 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Content-Type: application/json Sep 09 16:48:14.692999 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Host: 10.222.0.23 Sep 09 16:48:14.692999 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: Openstack-System-Scope: None Sep 09 16:48:14.692999 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: User-Agent: python-urllib3/1.26.12 Sep 09 16:48:14.692999 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Auth-Token: gAAAAABjG2zA2C3Urjs5rX1aJ4LKhkL3u9nZn6jfJf116bnd56Qt97VVQ7ocGpj0lL75heJHPdN6Cw3P9LXL57icrantDpvxWBIY8Uq_2L9Afi5dh46vkZJCYW06kaJAfmsx1WEU03C9lzGI0XC3nzAEIQPaqhPRx8PWaHcRcTSHjYzjfP4jc6o Sep 09 16:48:14.692999 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Domain-Id: None Sep 09 16:48:14.692999 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Domain-Name: None Sep 09 16:48:14.692999 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Identity-Status: Confirmed Sep 09 16:48:14.692999 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Is-Admin-Project: True Sep 09 16:48:14.692999 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Project-Domain-Id: default Sep 09 16:48:14.692999 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Project-Domain-Name: Default Sep 09 16:48:14.692999 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Project-Id: 5c52563210cf435696f3e3ae3907b0fb Sep 09 16:48:14.692999 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Project-Name: tempest-TestVolumeBootPattern-44960866 Sep 09 16:48:14.692999 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Role: member,reader Sep 09 16:48:14.692999 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Roles: member,reader Sep 09 16:48:14.694995 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5c52563210cf435696f3e3ae3907b0fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/5c52563210cf435696f3e3ae3907b0fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5c52563210cf435696f3e3ae3907b0fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_5c52563210cf435696f3e3ae3907b0fb"}]}] Sep 09 16:48:14.694995 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Tenant: tempest-TestVolumeBootPattern-44960866 Sep 09 16:48:14.694995 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Tenant-Id: 5c52563210cf435696f3e3ae3907b0fb Sep 09 16:48:14.694995 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-Tenant-Name: tempest-TestVolumeBootPattern-44960866 Sep 09 16:48:14.694995 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-User: tempest-TestVolumeBootPattern-44960866-project Sep 09 16:48:14.694995 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-User-Domain-Id: default Sep 09 16:48:14.694995 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-User-Domain-Name: Default Sep 09 16:48:14.694995 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-User-Id: 69ec3d4f006c4f8f815b0cad9f933208 Sep 09 16:48:14.694995 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: X-User-Name: tempest-TestVolumeBootPattern-44960866-project Sep 09 16:48:14.694995 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: method: > Sep 09 16:48:14.694995 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: exception: Instance d4bd5be5-501a-42aa-b8ad-4f302c5d3c77 could not be found. Sep 09 16:48:14.694995 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: action_args: {'id': 'd4bd5be5-501a-42aa-b8ad-4f302c5d3c77'} Sep 09 16:48:14.695974 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 16:48:14.695974 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:48:14.695974 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 16:48:14.695974 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 16:48:14.695974 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 16:48:14.695974 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 16:48:14.695974 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 16:48:14.695974 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 16:48:14.695974 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 16:48:14.695974 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 16:48:14.695974 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4bd5be5-501a-42aa-b8ad-4f302c5d3c77 could not be found. Sep 09 16:48:14.695974 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Sep 09 16:48:14.695974 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 16:48:14.695974 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Sep 09 16:48:14.695974 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:48:14.695974 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 16:48:14.695974 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 16:48:14.695974 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 16:48:14.695974 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 16:48:14.695974 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 16:48:14.697564 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 16:48:14.697564 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 09 16:48:14.697564 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 09 16:48:14.697564 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 09 16:48:14.697564 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 09 16:48:14.697564 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 16:48:14.697564 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 16:48:14.697564 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 16:48:14.697564 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 16:48:14.697564 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4bd5be5-501a-42aa-b8ad-4f302c5d3c77 could not be found. Sep 09 16:48:14.697564 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Sep 09 16:48:14.697564 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 16:48:14.697564 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Sep 09 16:48:14.697564 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:48:14.697564 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 16:48:14.697564 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 16:48:14.697564 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 16:48:14.697564 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 16:48:14.697564 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4bd5be5-501a-42aa-b8ad-4f302c5d3c77 could not be found. Sep 09 16:48:14.697564 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: ERROR nova.api.openstack.wsgi Sep 09 16:48:14.699544 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-088a6a70-eff2-4863-a89a-aab1f254306a tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Returning 404 to user: Instance d4bd5be5-501a-42aa-b8ad-4f302c5d3c77 could not be found. {{(pid=127196) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 16:48:14.699544 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-088a6a70-eff2-4863-a89a-aab1f254306a tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] 10.222.0.23 "DELETE /compute/v2.1/servers/d4bd5be5-501a-42aa-b8ad-4f302c5d3c77" status: 404 len: 111 microversion: 2.1 time: 0.029920 Sep 09 16:48:14.699544 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 544/1102] 10.222.0.23 () {58 vars in 1239 bytes} [Fri Sep 9 16:48:14 2022] DELETE /compute/v2.1/servers/d4bd5be5-501a-42aa-b8ad-4f302c5d3c77 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 16:48:14.703364 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-5376510f-3598-4304-b60d-0116ec41c70c tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:48:14.703986 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-5376510f-3598-4304-b60d-0116ec41c70c tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] [instance: d4bd5be5-501a-42aa-b8ad-4f302c5d3c77] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 16:48:14.710004 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5376510f-3598-4304-b60d-0116ec41c70c tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:48:14.710532 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5376510f-3598-4304-b60d-0116ec41c70c tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:48:14.710988 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5376510f-3598-4304-b60d-0116ec41c70c tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:48:14.711676 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5376510f-3598-4304-b60d-0116ec41c70c tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Acquiring lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 16:48:14.712129 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5376510f-3598-4304-b60d-0116ec41c70c tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 16:48:14.712557 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5376510f-3598-4304-b60d-0116ec41c70c tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Lock "48ce3bd6-80cf-484b-9bda-21ff297cb34a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 16:48:14.726173 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.wsgi [None req-5376510f-3598-4304-b60d-0116ec41c70c tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] HTTP exception thrown: Instance d4bd5be5-501a-42aa-b8ad-4f302c5d3c77 could not be found. Sep 09 16:48:14.727731 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-5376510f-3598-4304-b60d-0116ec41c70c tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Request method failure captured: Sep 09 16:48:14.727731 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: request: GET /compute/v2.1/servers/d4bd5be5-501a-42aa-b8ad-4f302c5d3c77 HTTP/1.1 Sep 09 16:48:14.727731 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Accept: application/json Sep 09 16:48:14.727731 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Accept-Encoding: identity Sep 09 16:48:14.727731 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Connection: close Sep 09 16:48:14.727731 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Content-Length: 0 Sep 09 16:48:14.727731 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Content-Type: application/json Sep 09 16:48:14.727731 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Host: 10.222.0.23 Sep 09 16:48:14.727731 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: Openstack-System-Scope: None Sep 09 16:48:14.727731 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: User-Agent: python-urllib3/1.26.12 Sep 09 16:48:14.727731 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Auth-Token: gAAAAABjG2zA2C3Urjs5rX1aJ4LKhkL3u9nZn6jfJf116bnd56Qt97VVQ7ocGpj0lL75heJHPdN6Cw3P9LXL57icrantDpvxWBIY8Uq_2L9Afi5dh46vkZJCYW06kaJAfmsx1WEU03C9lzGI0XC3nzAEIQPaqhPRx8PWaHcRcTSHjYzjfP4jc6o Sep 09 16:48:14.727731 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Domain-Id: None Sep 09 16:48:14.727731 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Domain-Name: None Sep 09 16:48:14.727731 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Identity-Status: Confirmed Sep 09 16:48:14.727731 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Is-Admin-Project: True Sep 09 16:48:14.727731 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Project-Domain-Id: default Sep 09 16:48:14.727731 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Project-Domain-Name: Default Sep 09 16:48:14.727731 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Project-Id: 5c52563210cf435696f3e3ae3907b0fb Sep 09 16:48:14.727731 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Project-Name: tempest-TestVolumeBootPattern-44960866 Sep 09 16:48:14.727731 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Role: member,reader Sep 09 16:48:14.727731 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Roles: member,reader Sep 09 16:48:14.729500 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5c52563210cf435696f3e3ae3907b0fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/5c52563210cf435696f3e3ae3907b0fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5c52563210cf435696f3e3ae3907b0fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_5c52563210cf435696f3e3ae3907b0fb"}]}] Sep 09 16:48:14.729500 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Tenant: tempest-TestVolumeBootPattern-44960866 Sep 09 16:48:14.729500 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Tenant-Id: 5c52563210cf435696f3e3ae3907b0fb Sep 09 16:48:14.729500 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-Tenant-Name: tempest-TestVolumeBootPattern-44960866 Sep 09 16:48:14.729500 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User: tempest-TestVolumeBootPattern-44960866-project Sep 09 16:48:14.729500 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User-Domain-Id: default Sep 09 16:48:14.729500 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User-Domain-Name: Default Sep 09 16:48:14.729500 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User-Id: 69ec3d4f006c4f8f815b0cad9f933208 Sep 09 16:48:14.729500 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: X-User-Name: tempest-TestVolumeBootPattern-44960866-project Sep 09 16:48:14.729500 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: method: > Sep 09 16:48:14.729500 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: exception: Instance d4bd5be5-501a-42aa-b8ad-4f302c5d3c77 could not be found. Sep 09 16:48:14.729500 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: action_args: {'id': 'd4bd5be5-501a-42aa-b8ad-4f302c5d3c77'} Sep 09 16:48:14.730394 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 16:48:14.730394 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:48:14.730394 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 16:48:14.730394 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 16:48:14.730394 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 16:48:14.730394 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 16:48:14.730394 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 16:48:14.730394 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 16:48:14.730394 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 16:48:14.730394 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 16:48:14.730394 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4bd5be5-501a-42aa-b8ad-4f302c5d3c77 could not be found. Sep 09 16:48:14.730394 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:48:14.730394 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 16:48:14.730394 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:48:14.730394 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:48:14.730394 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 16:48:14.730394 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 16:48:14.730394 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 16:48:14.730394 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 16:48:14.730394 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 16:48:14.731821 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 16:48:14.731821 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 16:48:14.731821 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 16:48:14.731821 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 16:48:14.731821 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 16:48:14.731821 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 16:48:14.731821 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 16:48:14.731821 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4bd5be5-501a-42aa-b8ad-4f302c5d3c77 could not be found. Sep 09 16:48:14.731821 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:48:14.731821 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 16:48:14.731821 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:48:14.731821 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 16:48:14.731821 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 16:48:14.731821 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 16:48:14.731821 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 16:48:14.731821 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 16:48:14.731821 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4bd5be5-501a-42aa-b8ad-4f302c5d3c77 could not be found. Sep 09 16:48:14.731821 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 09 16:48:14.733076 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-5376510f-3598-4304-b60d-0116ec41c70c tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Returning 404 to user: Instance d4bd5be5-501a-42aa-b8ad-4f302c5d3c77 could not be found. {{(pid=127198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 16:48:14.733076 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-5376510f-3598-4304-b60d-0116ec41c70c tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] 10.222.0.23 "GET /compute/v2.1/servers/d4bd5be5-501a-42aa-b8ad-4f302c5d3c77" status: 404 len: 111 microversion: 2.1 time: 0.029840 Sep 09 16:48:14.733076 dv-cinder-831247-27-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 559/1103] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Sep 9 16:48:14 2022] GET /compute/v2.1/servers/d4bd5be5-501a-42aa-b8ad-4f302c5d3c77 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 16:48:16.043555 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: DEBUG nova.api.openstack.wsgi [None req-1cf99d3d-6494-4a70-a451-837c828018c3 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] Calling method '.version_select at 0x7f24fb7540d0>' {{(pid=127196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 16:48:16.069697 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: INFO nova.api.openstack.requestlog [None req-1cf99d3d-6494-4a70-a451-837c828018c3 tempest-TestVolumeBootPattern-44960866 tempest-TestVolumeBootPattern-44960866-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-471889667" status: 202 len: 0 microversion: 2.1 time: 0.029772 Sep 09 16:48:16.070731 dv-cinder-831247-27-iscsi devstack@n-api.service[127196]: [pid: 127196|app: 0|req: 545/1104] 10.222.0.23 () {58 vars in 1260 bytes} [Fri Sep 9 16:48:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-471889667 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)